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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an image processing method and 
device capable of minimizing a user 1 s load for operation and precisely extracting 
an object, and a storage medium. 

SOLUTION: A memory 12 temporarily stores a dynamic image data inputted 
from an image input device 10 for several frames. A movement detecting device 
14 detects the movement quantity of each part on an intended frame from a 
plurality of frames stored in the memory 12. A block classifying device 16 
classifies each block on the intended frame to a background part and an object 
part according to the detection result of the movement detecting device 14. A 
profile setting device 18 sets an initial profile in the boundary between the 
background part and the object part according to the classification result of the 
block classifying device 16. A profile converging device 20 converges the initial 
profile along the actual profile of the object. The conversion result is displayed by 
a profile display device 22. The profile setting device 18 sets the conversion 



result of a reference frame as the initial profile of an adjacent frame, and the 
profile converging device 20 converges the profile in the adjacent frame. This 
processing is executed in both the direction from the reference frame to an end 
frame and the direction therefrom to a start frame. 
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* NOTICES * 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation, 

1. This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 

CLAIMS 
[Claim(s)] 

[Claim 1] The step which chooses a specific frame from the dynamic-image data 
constituted by the multiple frame, The step which generates the initial profile for 
an extract on the selected frame concerned, Based on the step which completes 
the initial profile concerned as the profile for [ concerned ] an extract, and the 
result of the profile convergence concerned, the initial profile for [ concerned ] an 
extract is set up to other frames, the step completed as the profile for 
[ concerned ] an extract based on the set-up initial profile — having - being 
concerned - others - the image-processing approach characterized by the 
ability to set up the frame of before and the back in time as a frame than the 
selected frame concerned. 

[Claim 2] The step to which the step which generates the initial profile concerned 
divides the selected frame concerned into two or more blocks, The step which 



-moves by the block unit concerned-and-computes an amount, and the step into 
which the boundary block concerned corresponding to [ move and ] a boundary 
with the background for [ for / the block of the frame concerned to / concerned / 
an extract / concerned ] an extract based on an amount by which it was detected 
is classified, The image-processing approach according to claim 1 characterized 
by having the step which generates the initial profile concerned based on the 
classification result concerned. 

[Claim 3] The step into which the boundary block concerned is classified is the 
image-processing approach according to claim 2 characterized by dividing and 
classifying a boundary block according to the re-divided block unit re-about the 
block concerned. 

[Claim 4] The step into which the boundary block concerned is classified is the 
image-processing approach according to claim 2 or 3 characterized by 
classifying the block for an extract corresponding to the candidate for an extract 
concerned, and the background block corresponding to the background for 
[ concerned ] an extract. 

[Claim 5] The step into which the boundary block concerned is classified is an 
image processing system according to claim 4 characterized by classifying one 
[ at least ] block of the block for an extract concerned which touches mutually, 
and a background block with a boundary block. 



[Claim 6] The step into which the boundary block concerned is classified is the 
image-processing approach according to claim 3 characterized by performing 
re-division to the boundary block corresponding to a boundary with the 
background of the for concerned for [ for an extract / concerned ] an extract. 
[Claim 7] The image-processing approach given in any 1 term of claims 2-6 
characterized by the amount of motions concerned being a motion vector. 
[Claim 8] The step into which the boundary block concerned is classified is the 
image-processing approach according to claim 7 characterized by classifying a 
boundary block according to the occurrence frequency of the amount of motions 
concerned, and the condition of a contiguity block. 

[Claim 9] The step which generates the initial profile concerned is the 
image-processing approach given in any 1 term of claims 2-8 characterized by 
generating the initial profile concerned with the straight line or curve which 
passes along the block edge of the boundary block concerned, or the point 
inside a block. 

[Claim 10] The step which completes the initial profile concerned as the profile 
for [ concerned ] an extract is the image-processing approach given in any 1 
term of claims 1-9 characterized by repeating a convergence operation so that 
the energy function which set the initial profile concerned as the initial value of a 
dynamic contour model, and defined it beforehand may serve as the minimum. 



[Claim 11] -The step which - chooses- the specific frame concerned is the 
image-processing approach given in any 1 term of claims 1-10 characterized by 
having the step which calculates characteristic quantity from each frame of two 
or more frames concerned, the step which measures the characteristic quantity 
~6f eadh i frame concern^ and the step 

which uses one frame as the specific frame concerned from the high frame of 

! 

the similarity concerned. 

[Claim 12] The step to which the step which calculates the characteristic quantity 
concerned divides an object frame into two or more blocks, The step classified 
into the step which moves by the block unit concerned and detects an amount, 
and the boundary block corresponding to the boundary of the background 
concerned the block for the extract corresponding to [ move and ] the candidate 
for an extract concerned according to an amount by which it was detected 
concerned, the background block corresponding to the background for 
[ concerned ] an extract, and for [ concerned ] an extract, The image-processing 
approach according to claim 11 characterized by having the step which 
calculates the characteristic quantity of the frame concerned according to the 
classification result concerned. 

[Claim 13] The characteristic quantity of the frame concerned is the block count 
for an extract concerned, the background block count concerned, or the 



image-processing approach according to claim 12 characterized by being the 
ratio of the block for an extract and the background block concerned concerned. 
[Claim 14] The characteristic quantity of the frame concerned is the 
image-processing approach according to claim 12 characterized by being the 
area fon base^^ concerned / concerned ] an extract, 

the area of the background concerned based on the background block 
concerned, or a rate of surface ratio with the background concerned based on 
the background block concerned for [ based on the block for an extract 
concerned / concerned ] an extract. 

[Claim 15] The characteristic quantity of the frame concerned is the 
image-processing approach according to claim 12 characterized by being the 
combination of the greatest die length of the distance between two on the 
boundary length for [ based on the block for an extract concerned / concerned ] 
an extract, the circumscription rectangle based on the block for an extract 
concerned, or the periphery of the block for an extract concerned or the greatest 
die length of the distance between two on the periphery of the block for an 
extract concerned, and the minimum die length. 

[Claim 16] The step into which the block concerned in the step which calculates 
the characteristic quantity concerned is classified is the image-processing 
approach given in any 1 term of claims 12-15 characterized by re-dividing the 



block concerned and classifying-a-block-according to the re-divided block unit. 
[Claim 17] The step to which the step which calculates the characteristic quantity 
concerned divides an object frame into two or more blocks, The step classified 
into the step which moves by the block unit concerned and detects an amount, 
and the boLmdary "block corresponding To the boundary of the background 

concerned the block for the extract corresponding to [ move and ] the candidate 

i 

for an extract concerned according to an amount by which it was detected 
concerned, the background block corresponding to the background for 
[ concerned ] an extract, and for [ concerned ] an extract, The step which 
generates an initial profile to the candidate for an extract concerned based on 
the classification result concerned, The image-processing approach according to 
claim 11 characterized by having the step which completes the initial profile 
concerned as the profile for [ concerned ] an extract, and the step which 
calculates the characteristic quantity of the frame concerned from the 
convergent profile configuration concerned. 

[Claim 18] The step which generates the initial profile concerned in the step 
which calculates the characteristic quantity concerned is the image-processing 
approach according to claim 17 characterized by generating the initial profile 
concerned with the straight line or curve which passes along the block edge of 
the boundary block concerned, or the point inside a block. 



[Claim -19] The step which -completes the initial profile concerned in the step 
which calculates the characteristic quantity concerned as the profile of the 
extract symmetry is the image-processing approach according to claim 17 or 18 
characterized by repeating a convergence operation so that the energy function 
which setThelnTtTaTprofile concern^* as" the initial" value of a dynamic contour 
model, and defined it beforehand may serve as the minimum. 
[Claim 20] The step which generates an initial profile to each frame of the 
dynamic-image data constituted by the multiple frame, The step which chooses 
the initial profile of a specific frame out of the initial profile of each generated 
frame concerned, The step which completes the initial profile of the selected 
frame concerned as the profile for [ concerned ] an extract, Based on the result 
of the profile convergence concerned, the initial profile for [ concerned ] an 
extract is set up to other frames, the step completed as the profile for 
[ concerned ] an extract based on the set-up initial profile - having - being 
concerned - others - the image-processing approach characterized by the 
ability to set up the frame of before and the back in time as a frame than the 
selected frame concerned. 

[Claim 21] The step which generates an initial profile to each frame of the 
dynamic-image data constituted by the multiple frame, The step which 
completes the initial profile of each frame concerned as the profile for 



[ concerned ] -an extract, The step -which chooses a -specific frame out of the 
profile of each frame concerned which it converged, Based on the result of 
profile convergence of the selected frame concerned, the initial profile for 
[ concerned ] an extract is set up to other frames, the step completed as the 
proffle fdr [ concerned ] an extract based on the set-up initial profile — having — 

being concerned — others — the image-processing approach characterized by 

i 

the ability to set up the frame of before and the back in time as a frame than the 
selected frame concerned. 

[Claim 22] The step which generates an initial profile to each frame of the 
dynamic-image data constituted by the multiple frame, The step which 
completes the initial profile of each frame concerned as the profile for 
[ concerned ] an extract, The step which sets up the initial profile for 
[ concerned ] an extract to other frames based on the result of profile 
convergence of each frame concerned, and is completed as the profile for 
[ concerned ] an extract based on the set-up initial profile, it was based on the 
result of profile convergence of each frame concerned — being concerned — 
others — the step which chooses a specific result out of the convergence result 
of a frame - having - being concerned - others - the image-processing 
approach characterized by the ability to set up the frame of before and the back 
in time as a frame than the selected frame concerned. 



[Claim 23] The step to which the step -which generates the initial profile 
concerned divides the selected frame concerned into two or more blocks, The 
step which moves by the block unit concerned and computes an amount, and 
the step into which the boundary block concerned corresponding to [ move and ] 
a bounidai7~^th ll^lDackground fbrTfor 7~the block of the frame concerned to / 
concerned / an extract / concerned ] an extract based on an amount by which it 
was detected is classified, The image-processing approach given in any 1 term 
of claims 20-22 characterized by having the step which generates the initial 
profile concerned based on the classification result concerned. 
[Claim 24] The step into which the boundary block concerned is classified is the 
image-processing approach according to claim 23 characterized by dividing and 
classifying a boundary block according to the re-divided block unit re-about the 
block concerned. 

[Claim 25] The step into which the boundary block concerned is classified is the 
image-processing approach according to claim 23 or 24 characterized by 
classifying the block for an extract corresponding to the candidate for an extract 
concerned, and the background block corresponding to the background for 
[ concerned ] an extract. 

[Claim 26] The step into which the boundary block concerned is classified is an 
image processing system according to claim 25 characterized by classifying one 



- [-at least ] block of the-block for-an-extract- concerned which touches mutually, 
and a background block with a boundary block. 

[Claim 27] The step into which the boundary block concerned is classified is the 
image-processing approach according to claim 23 characterized by performing 
"re^divisTon to the boundary block OTrT^^nding" to a boundary with the 

background of the for concerned for [ for an extract / concerned ] an extract. 

i 

[Claim 28] The image-processing approach given in any 1 term of claims 23-27 
characterized by the amount of motions concerned being a motion vector. 
[Claim 29] The step into which the boundary block concerned is classified is the 
image-processing approach according to claim 28 characterized by classifying a 
boundary block according to the occurrence frequency of the amount of motions 
concerned, and the condition of a contiguity block. 

[Claim 30] The step which generates the initial profile concerned is the 
image-processing approach given in any 1 term of claims 23-29 characterized 
by generating the initial profile concerned with the straight line or curve which 
passes along the block edge of the boundary block concerned, or the point 
inside a block. 

[Claim 31] The step which completes the initial profile concerned as the profile 
for [ concerned ] an extract is the image-processing approach given in any 1 
term of claims 20-30 characterized by repeating a convergence operation so that 



the energy function which set the initial profile concerned as the initial value of a 
dynamic contour model, and defined it beforehand may serve as the minimum. 
[Claim 32] The storage characterized by memorizing the program software for 
performing the image-processing approach indicated by any 1 term of claims 

1-31. . ; 

[Claim 33] A selection means to choose a specific frame from the 
dynamic-image data constituted by the multiple frame, An initial profile 
generation means to generate the initial profile for an extract on the selected 
frame concerned, Based on a profile convergence means to complete the initial 
profile concerned as the profile for [ concerned ] an extract, and the result of the 
profile convergence concerned, the initial profile for [ concerned ] an extract is 
set up to other frames, the control means which completes the set-up initial 
profile concerned as the profile for [ concerned ] an extract with the profile 
convergence means concerned — having — being concerned — others — the 
image processing system characterized by the ability to set up the frame of 
before and the back in time as a frame than the selected frame concerned. 
[Claim 34] A division means by which the initial profile generation means 
concerned divides the selected frame concerned into two or more blocks, A 
detection means to move by the block unit concerned and to detect an amount, 
and a classification means to classify the boundary block concerned 



corresponding to [-move and ] a boundary-with- the background for [ for / the 
block of the frame concerned to / concerned / an extract / concerned ] an extract 
based on an amount by which it was detected, The image processing system 
according to claim 33 characterized by having a setting means to set up the 
initial profile concerned based on ttie classification result concerned. 

[Claim 35] The classification means concerned is an image processing system 

i 

according to claim 34 characterized by dividing and classifying a boundary block 

according to the re-divided block unit re-aboutthe block concerned. 

[Claim 36] The classification means concerned is an image processing system 

according to claim 34 or 35 characterized by classifying the block for an extract 

corresponding to the candidate for an extract concerned, and the background 

block corresponding to the background for [ concerned ] an extract. 

[Claim 37] The classification means concerned is an image processing system 

according to claim 35 characterized by performing re-division to the boundary 

block corresponding to a boundary with the background of the for concerned for 

[ for an extract / concerned ] an extract. 

[Claim 38] An image processing system given in any 1 term of claims 34-37 
characterized by the amount of motions concerned being a motion vector. 
[Claim 39] The classification means concerned is an image processing system 
given in any 1 term of claims 34-38 characterized by classifying a boundary 



-block- according -to- the-occurrence- frequency- of the amount ~ of motions 
concerned, and the condition of a contiguity block. 

[Claim 40] The profile convergence means concerned is an image processing 
system given in any 1 term of claims 33-39 characterized by repeating a 
convergence operation so that the energy function which set the initial profile 
concerned as the initial value of a dynamic contour model, and defined it 
beforehand may serve as the minimum. 

[Claim 41] The selection means concerned is an image processing system given 
in any 1 term of claims 33-40 characterized by having a characteristic quantity 
detection means to calculate characteristic quantity from each frame of two or 
more frames concerned, a judgment means for inter-frame to compare the 
characteristic quantity of each frame concerned, and to judge similarity, and a 
specific frame selection means to choose one frame from the high frame of the 
similarity concerned as the specific frame concerned. 

[Claim 42] The characteristic quantity detection means concerned divides an 
object frame into two or more blocks, and runs by the block unit concerned, and 
an amount is detected. It classifies into the boundary block corresponding to the 
boundary of the background concerned the block for the extract corresponding 
to [ move and ] the candidate for an extract concerned according to an amount 
by which it was detected concerned, the background block corresponding to the 



— background for [ concerned -]- an- extract, and-for [ concerned ] an extract. The 
image processing system according to claim 41 characterized by calculating the 
characteristic quantity of the frame concerned according to the classification 
result concerned. 

TCIaim^3yAn i initial profile generation means to generate an initial profile to each 

frame of the dynamic-image data constituted by the multiple frame, A selection 

i 

means to choose the initial profile of a specific frame out of the initial profile of 
each generated frame concerned, Based on a profile convergence means to 
complete the initial profile concerned as the profile for [ concerned ] an extract, 
and the result of the profile convergence concerned, the initial profile for 
[ concerned ] an extract is set up to other frames, the control means which 
completes the set-up initial profile concerned as the profile for [ concerned ] an 
extract with the profile convergence means concerned — having — ' being 
concerned — others -- the image processing system characterized by the ability 
to set up the frame of before and the back in time as a frame than the selected 
frame concerned. 

[Claim 44] An initial profile generation means to generate an initial profile to each 
frame of the dynamic-image data constituted by the multiple frame, A profile 
convergence means to complete the initial profile of each frame concerned as 
the profile for [ concerned ] an extract, A selection means to choose a specific 



- frame-out-of the profile of each-frame concerned which it converged, Based on 
the result of profile convergence of the selected frame concerned, the initial 
profile for [ concerned ] an extract is set up to other frames, the control means 
which completes the set-up initial profile concerned as the profile for 
[ concerned ] an extracTwith the profile convergence means concerned — having 
- being concerned — others - the image processing system characterized by 
the ability to set up the frame of before and the back in time as a frame than the 
selected frame concerned. 

[Claim 45] An initial profile generation means to generate an initial profile to each 
frame of the dynamic-image data constituted by the multiple frame, A profile 
convergence means to complete the initial profile of each frame concerned as 
the profile for [ concerned ] an extract, The control means which the initial profile 
for [ concerned ] an extract is set [ control means ] up to other frames based on 
the result of profile convergence of each frame concerned, and completes the 
set-up initial profile concerned as the profile for [ concerned ] an extract with the 
profile convergence means concerned, it was based on the result of profile 
convergence of each frame concerned — being concerned - others - a selection 
means to choose a specific result out of the convergence result of a frame - 
having -- being concerned — others - the image processing system 
characterized by the ability to set up the frame of before and the back in time as 



-a-frame-than the selected-frame concerned. - - 

[Claim 46] A division means by which the initial profile generation means 
concerned divides the selected frame concerned into two or more blocks, A 
detection means to move by the block unit concerned and to detect an amount, 
and a classification" Trieans To classify the boundary block concerned 

corresponding to [ move and'] -a boundary with the background for [ for / the 

i 

block of the frame concerned to / concerned / an extract / concerned ] an extract 
based on an amount by which it was detected, An image processing system 
given in any 1 term of claims 43-45 characterized by having a setting means to 
set up the initial profile concerned based on the classification result concerned. 
[Claim 47] The classification means concerned is an image processing system 
according to claim 46 characterized by dividing and classifying a boundary block 
according to the re-divided block unit re-about the block concerned. 
[Claim 48] The classification means concerned is an image processing system 
according to claim 46 or 47 characterized by classifying the block for an extract 
corresponding to the candidate for an extract concerned, and the background 
block corresponding to the background for [ concerned ] an extract. 
[Claim 49] The classification means concerned is an image processing system 
according to claim 47 characterized by performing re-division to the boundary 
block corresponding to a boundary with the background of the for concerned for 



[ for an extract / concerned ]-an extract - . - 

[Claim 50] An image processing system given in any 1 term of claims 46-49 
characterized by the amount of motions concerned being a motion vector. 
[Claim 51] The classification means concerned is an image processing system 
given in "any 1 term of "claims 46-50 characterized by classifying a boundary 
block according to the occurrence frequency of the amount of motions 
concerned, and the condition of a contiguity block. 

[Claim 52] The profile convergence means concerned is an image processing 
system given in any 1 term of claims 43-51 characterized by repeating a 
convergence operation so that the energy function which set the initial profile 
concerned as the initial value of a dynamic contour model, and defined it 
beforehand may serve as the minimum. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the storage which memorizes the 
program software which performs the approach in the image-processing 



approach of more specifically extracting the object in a dynamic image about a 
storage and equipment, and a list at the image-processing approach and an 
equipment list. 
[0002] 

[Description of the Prior Art] In recent years, a dynamic image is grasped as 

consisting of composition of a component called an object, the method which 

i 

carries out compression coding is examined by making the object into a unit, and 
a standardization is advancing as current and MPEG-4. Since an object can take 
the configuration of arbitration, it is expressed in the combination of the data 
called the shape showing configuration information, and the data called the 
texture showing the contents of the image. 

[0003] The chroma-key separation method using the studio set etc. as a 
generation method of an object, the approach of generating the target object 
with computer graphics (CG), the approach of extracting from natural drawing, 
etc. are learned. 

[0004] The chroma-key method is an approach of extracting the target object, by 
preparing the uniform blue background called the blue back to studio, and 
cutting out a blue part from a photography image. 

[0005] With computer graphics (CG), since the image of an arbitration 
configuration is generable from the start, it is not necessary to consider 



especially extract processing. In the case of an animation image, if it considers 
that each animation eel is each object, it can process like CG. 
[0006] When extracting an object from natural drawing, energy minimization of 
the dynamic contour model called SUNEKUSU is known well (for example, 
Michael Kass, Andrew Witkin, and Demetri Terzopoulos, "Snakes: Active 
Contour Models", International Journal of ComputerVision, Vol.1, No.3, 
pp.321 -331, 1988). 

[0007] SUNEKUSU defines the energy function used as min, when a border line 
is extracted, and it calculates the minimum solution by repeated calculation from 
suitable initial value. An energy function is defined by the linear combination of 
the external energy of the constraint which passes along an edge point, and the 
internal energy which is constraint of smoothness. 

[0008] In order to apply SUNEKUSU, it is necessary to specify the profile for an 
extract roughly as an initial profile. In the case of a dynamic image, a setup of an 
initial profile is needed for every frame, but it becomes automatable by making 
the extract result of a front frame into the initial value of the present frame. The 
technique of asking for the border line which corresponds by inter-frame is called 
tracking. 
[0009] 

[Problem(s) to be Solved by the Invention] Each of these extract approaches 



- includes- the difficult -trouble. That -is,-when the chroma-key method needs to 
have a uniform background color and the high extract of precision is aimed at, a 
large-scale studio set is needed. Moreover, since an object cannot be correctly 
extracted when the object object contains the background color, the target color 
is restrained. 

[0010] By computer graphics and animation, although extract processing is 

i 

unnecessary, it has the fatal fault that it cannot respond to natural drawing which 
was photoed with the video camera. 

[0011] The approach of extracting an object from natural drawing has the low 
constraint to the contents of an image, and while there is an advantage that 
versatility is high, it has the fault that it is necessary to specify an initial profile 
somewhat correctly. The minimum solution of a dynamic contour model depends 
this on being greatly influenced of an initial profile. When separated from the 
profile of an object with an actual initial profile, it stops that is, being in 
agreement with the profile of an object with the actual convergence result of an 
operation. An initial profile setup has the common approach which a user sets up 
using GUI (graphical user interface), such as a mouse. An initial profile setup by 
manual actuation has bad operability, and a reproducible initial profile setup is 
difficult. A user's burden becomes large, so that the configuration of a profile 
becomes complicated. 



- -[0012] What is necessary is just to generate an initial profile automatically, in 
order to solve this technical problem. In order to carry out automatic extracting of 
the initial profile, it is effective to use inter-frame motion information in addition to 
the color in a frame and the information on a texture. However, in order to use 
motion information, the relative motion between the backgrounds for an extract 
must be detectable. 

[0013] This problem is explained in more detail using drawing 38 . Drawing 38 is 
a mimetic diagram explaining a motion of the object of each frame in an 
animation sequence. F1-F6 presuppose that it is the frame which continues in 
time, and a frame F1 is a start frame and a frame F6 is an end frame. The start 
frame F1 and its following frame F2 completely have a the same configuration in 
the screen where a photographic subject and a background are not moving, and 
it is in the condition. In this case, even if it is going to detect the amount of both 
frame lost motion, a motion of an object is the same as a motion of a background. 
An object cannot be extracted at this time. In the condition that both the 
background and the object are standing it still, also when the pan of the camera 
is carried out, the same result is brought. 

[0014] Possibility that the relative motion between the frames left in time then 
objects, and backgrounds like the frame F4 instead of a contiguity frame will be 
detectable increases a reference frame. However, if correspondence of 



-backgrounds and correspondence-of objects become difficult and do not extend 
the search range in this case, it is hard coming to take correspondence of 
backgrounds and objects. This is because possibility that form status 
change-ization will become large is high when a time interval opens. Therefore, 
the approach of setting up an initial profile in quest of start frame lost motion has 

low versatility, and it is difficult to obtain a good result also by subsequent 

i 

tracking. Moreover, a good extract result is not necessarily obtained by the 
approach of setting up an initial profile in quest of start frame lost motion. 
[0015] In order to obtain an always good result, it is effective to find the frame 
which can detect a relative motion of a background and an object easily, and to 
carry out tracking to a cross direction on the basis of the frame. The activity 
which finds this criteria frame out of a series of sequences serves as a big 
burden for a user. 

[0016] This invention is aimed at showing the image-processing approach and 
equipment list which the burden of user actuation has and can extract ah object 
to accuracy more in view of such a trouble a storage. [ few ] 
[0017] 

[Means for Solving the Problem] The step which chooses a specific frame from 
the dynamic-image data with which the image-processing approach concerning 
this invention is constituted by the multiple frame, The step which generates the 



initial profile for an extract on the selected -frame concerned, Based on the step 
which completes the initial profile concerned as the profile for [ concerned ] an 
extract, and the result of the profile convergence concerned, the initial profile for 
[ concerned ] an extract is set up to other frames, the step completed as the 
profile for [ concerned ] an extract based on the set-up initial profile -- having - 
being concerned - others - it is characterized by the ability to set up the frame 
of before and the back in time as a frame than the selected frame concerned. 
[0018] The step to which the image-processing approach concerning this 
invention generates an initial profile to each frame of the dynamic-image data 
constituted by the multiple frame again, The step which chooses the initial profile 
of a specific frame out of the initial profile of each generated frame concerned, 
The step which completes the initial profile of the selected frame concerned as 
the profile for [ concerned ] an extract, Based on the result of the profile 
convergence concerned, the initial profile for [ concerned ] an extract is set up to 
other frames, the step completed as the profile for [ concerned ] an extract based 
on the set-up initial profile - having - being concerned - others - it is 
characterized by the ability to set up the frame of before and the back in time as 
a frame than the selected frame concerned. 

[0019] The step to which the image-processing approach concerning this 
invention generates an initial profile to each frame of the dynamic-image data 



-constituted- by the multiple-frame -again, The step- which completes the initial 
profile of each frame concerned as the profile for [ concerned ] an extract, The 
step which chooses a specific frame out of the profile of each frame concerned 
which it converged, Based on the result of profile convergence of the selected 
frame concerned, the initial profile for [ concerned ] an extract is set up to other 

frames, the step completed as the profile for [ concerned ] an extract based on 

i 

the set-up initial profile — having - being concerned — others — it is characterized 
by the ability to set up the frame of before and the back in time as a frame than 
the selected frame concerned. 

[0020] The step to which the image-processing approach concerning this 
invention generates an initial profile to each frame of the dynamic-image data 
constituted by the multiple frame again, The step which completes the initial 
profile of each frame concerned as the profile for [ concerned ] an extract, The 
step which sets up the initial profile for [ concerned ] an extract to other frames 
based on the result of profile convergence of each frame concerned, and is 
completed as the profile for [ concerned ] an extract based on the set-up initial 
profile, it was based on the result of profile convergence of each frame 
concerned — being concerned - others — the step which chooses a specific 
result out of the convergence result of a frame — having — being concerned — 
others — it is characterized by the ability to set up the frame of before and the 



back in-time as a-frame than the selected-frame concerned. - 
[0021] The program . software which performs the above-mentioned 
image-processing approach is stored in the storage concerning this invention. 
[0022] A selection means to choose a specific frame from the dynamic-image 
data with which the image processing system concerning this invention is 
constituted by the multiple frame, An initial profile generation means to generate 
the initial profile for an extract on the selected frame concerned, Based on a 
profile convergence means to complete the initial profile concerned as the profile 
for [ concerned ] an extract, and the result of the profile convergence concerned, 
the initial profile for [ concerned ] an extract is set up to other frames, the control 
means which completes the set-up initial profile concerned as the profile for 
[ concerned ] an extract with the profile convergence means concerned — having 
— being concerned — others — it is characterized by the ability to set up the frame 
of before and the back in time as a frame than the selected frame concerned. 
[0023] An initial profile generation means by which the image processing system 
concerning this invention generates an initial profile to each frame of the 
dynamic-image data constituted by the multiple frame again, A selection means 
to choose the initial profile of a specific frame out of the initial profile of each 
generated frame concerned, Based on a profile convergence means to complete 
the initial profile concerned as the profile for [ concerned ] an extract, and the 



—result of-the-profile convergence concerned, the initial profile for [ concerned ] an 
extract is set up to other frames, the control means which completes the set-up 
initial profile concerned as the profile for [ concerned ] an extract with the profile 
convergence means concerned — having — being concerned — others it is 
cTTaracterized by the abilityto set up the frame of before and the back in time as 

a frame than the selected frame concerned. 

i 

[0024] An initial profile generation means by which the image processing system 
concerning this invention, generates an initial profile to each frame of the 
dynamic-image data constituted by the multiple frame again, A profile 
convergence means to complete the initial profile of each frame concerned as 
the profile for [ concerned ] an extract, A selection means to choose a specific 
frame out of the profile of each frame concerned which it converged, Based on 
the result of profile convergence of the selected frame concerned, the initial 
profile for [ concerned ] an extract is set up to other frames, the control means 
which completes the set-up initial profile concerned as the profile for 
[ concerned ] an extract with the profile convergence means concerned — having 
- being concerned - others - it is characterized by the ability to set up the frame 
of before and the back in time as a frame than the selected frame concerned. 
[0025] An initial profile generation means by which the image processing system 
concerning this invention generates an initial profile to each frame of the 



-dynamie-image— data- constituted by the- multiple frame again, A profile 
convergence means to complete the initial profile of each frame concerned as 
the profile for [ concerned ] an extract, The control means which the initial profile 
for [ concerned ] an extract is set [ control means ] up to other frames based on 
the result of profile convergence^ of each frame concerned, and completes the 
set-up initial profile concerned as the profile for [ concerned ] an extract with the 
profile convergence means concerned, it was based on the result of profile 
convergence of each frame concerned — being concerned — others — a selection 
means to choose a specific result out of the convergence result of a frame - 
having — being concerned - others — it is characterized by the ability to set up 
the frame of before and the back in time as a frame than the selected frame 
concerned. 
[0026] 

[Example] Hereafter, the example of this invention is explained to a detail with 
reference to a drawing. 

[0027] Drawing 1 shows the outline configuration block Fig. of the 1st example of 
this invention. A picture input device 10 consists of a video camera, picture 
reproducer, etc., and inputs a dynamic-image signal into memory 12. Memory 12 
stores temporarily the dynamic-image data inputted from a picture input device 
10 by several frames. Motion detection equipment 14 detects the amount of 



-motions-of each part on-an -attention frame from the image data of two or more 
frames memorized by memory 12. Block sort equipment 16 classifies each block 
on an attention frame into a part for a background, and an object part according 
to the detection result of motion detection equipment 14. The profile setting 
device~f8 sets an initial profile "as the boundary of a part for a background, and 

an object part according to the classification result of block sort equipment 16. 

i 

[0028] Profile convergence equipment 20 converges the initial profile set up with 
the profile setting device 18 so that the actual profile of an object may be met. 
The convergent result is transmitted and displayed on the profile display 22 
through memory 12. When it is not what a profile convergence result should 
satisfy, a user changes an attention frame with the image selecting arrangement 
24, and redoes profile convergence by profile convergence equipment 20. 
[0029] On the other hand, when you are what can satisfy a profile convergence 
result, let an attention frame be a criteria frame. If a criteria frame is determined, 
the profile setting device 18 will set up the convergence result of a criteria frame 
as an initial profile of a contiguity frame, and profile convergence equipment 20 
will converge a profile with a contiguity frame. This processing is performed in 
the both directions of the direction which goes to a frame from a criteria frame, 
and the direction which goes to a start frame. Finally the profile of an object is 
called for with all frames. The image output unit 26 outputs the result obtained by 



doing- in-this-way-as border-line data or- mask data in- which the inside and 
outside of an object are shown. 

[0030] Drawing 2 shows the operation flow chart of this example. The frame 
which sets up an initial profile is chosen from all frames (S1). An initial profile 1 is 
set up by^automatic processing to the selected frame (S2), and it is made to 
converge on an actual profile (S3). A dynamic contour model is used for 
convergence of a profile. If it cannot be satisfied with a convergence result, the 
initial profile setting frame of (S4) is changed into another frame, and 
convergence of an initial profile setup and a profile is repeated (S2, S3). While it 
has been the same, the condition of convergence of a profile may be changed 
for an initial profile setting frame. 

[0031] When the convergence result of a profile can be satisfied, the tracking to 
a frame is performed by using the initial profile setting frame of (S4) as a criteria 
frame (S6). Then, the tracking from a criteria frame to a start frame is performed 
(S8). It means that the object was extracted from the start frame with all the 
frames to a frame by this. Of course, the result is the same even if it performs the 
tracking to a frame from a criteria frame, after performing the tracking from a 
criteria frame to a start frame. 

[0032] Drawing 3 shows the detailed flow chart of an initial automatic profile 
setup (S2) of drawing 2 . Drawing 4 thru/or drawing 9 show a frame and its 



-example of-processing. Drawing -4 . shows the-example of an object frame of an 
initial automatic profile setup, and drawing 5 shows the next frame of the frame 
shown in drawing 4 . Drawing 6 thru/or drawing 9 are the mimetic diagrams 
showing the processing middle of an initial automatic profile setup. 

" [0"0'3"3]"Ah~object fram^(^rawin£ 4" ) is divided into* the" block of predetermined 

size as shown in drawing 6 (S11), and the amount of motions of each block is 

i 

computed (S12). the approach by which this is generally known as pattern 
matching of a block - each block -- the following frame ( drawing 5 ) - it is the 
processing which asks for which location is supported and asks for which has 
shifted from the same location on a screen for every block as a motion vector, 
the performance index of matching - for example, the difference during a block 
- a sum of squares or difference - it is the absolute value sum etc. 
[0034] If a motion vector can be found to all blocks, each block will be classified 
according to the value of a motion vector (S13). A background moves by the 
example shown in drawing 4 and drawing 5 leftward toward a screen, and the 
object is moving by it rightward relatively. If the blocks with the motion vector of 
the approximated value are collected, the background block which moves 
leftward can be extracted as most blocks, and the block of the object which 
moves rightward can be extracted as many blocks to a degree. 
[0035] However, since it cannot ask for the field which corresponds from the 



following frame -when-the block contains both a part-for abackground, and the 
object part, a different value also from a background block and the block of an 
object may be taken. By this example, it is considered that such a block is a 
boundary block between the block of an object, and the block of a background. 
About a boundary blocks again, block division is performed and it classifies any 
of a part for a background, an object part, or a boundary part they are according 
to the block of smaller magnitude. 1 time or 2 times or more are sufficient as the 
re-number of fractionation of a boundary part. Of course, indeed, if a count 
increases, although precision becomes good, a processing burden will increase. 
[0036] Drawing 7 shows a block and boundary block of the object to the first 
block division. Drawing 8 shows a block and boundary block of the object after 
carrying out block division again and classifying a boundary block in the example 
shown in drawing 7 . 

[0037] If a block sort is completed (S13), a border line (initial profile) will be set 
up between the block of an object and a boundary block, and a background 
block (S14). Drawing 9 shows the set-up initial profile and the profile of an object 
repeatedly. An initial profile does not necessarily need to be set to the boundary 
itself which touches a background block, and may connect the middle point on 
the core of a boundary block, or the boundary line of a block by the straight line 
or the spline curve. 



— [0038] In order to complete the-set-up initial -profile to the profile of an actual 
object, the dynamic contour model called SUNEKUSU is used. Generally 
SUNEKUSU is a profile (closed curve) expressed with a parameter on an image 
plane (xy). 

v(s)=(x(s),y(s)) \ — ----- - 

However, it is the profile extract model with which it deforms so that the energy 

i 

function defined by the following type (1) in 0<=s<=1 may be minimized, and the 

configuration is decided as the minimum condition of energy. 

[0039] 

[Equation 1] 

Esnake{v(s))=9 1 (Eint(v(s)+Eimege<v(s))+Econ(v{s))ds (1) 

Espiine(v(s))= -l{av*(s) 2 + pvjs) 2 } (2) 
2 

E€dge(v(s))=-^ y | V | (v(s))| 2 (3) 

However, Eint is [ image energy and Econ of internal energy and Eimage ] 
external energy. Econ is used when using the force from the outside 
compulsorily to SUNEKUSU. What is necessary is just to use external energy if 
needed. 

[0040] In many cases, Espline shown in the formula (2) showing the smoothness 
of a profile is used at Eint. v' and v" (s) are the primary differential and secondary 



differential of v (s) (s), respectively. Although alpha and beta are weighting 
factors and it is generally the function of s, it considers as a constant here. By 
minimization of Espline, SUNEKUSU receives the force contracted smoothly. 
[0041] Eedge shown in the formula (3) defined using the brightness I of an image 
(v (s))1s "weT used* for Eimage7 magnitude of brightness 

inclination. SUNEKUSU receives the force which can be drawn near to an edge 
by minimization of Eedge. gamma is a weighting factor to image energy. 
[0042] It means that the mask data to an initial profile setting frame were 
obtained by the processing so far. 

[0043] Drawing 10 shows the detailed flow chart of the tracking (S6) to a frame 
from an initial profile setting frame. Let the following frame be the present frame 
in time [ an initial profile setting frame ] (S21). The profile of a front frame is 
copied to the present frame in time (S22), and a profile is completed as the 
boundary of an object like S3 by making this copied profile into an initial profile 
(S23). After being completed by the profile, the present frame judges whether it 
is an end frame (S24). If the present frame is not an end frame (S24), the 
following frame will be used as the present frame in time (S21), and subsequent 
processings (S22, S23) will be repeated. When the present frame is an end 
frame (S24), it means ending the tracking to a frame. 

[0044] Drawing 11 shows the detailed flow chart of the tracking (S8) from an 



- initial profile setting frame to a start frame -Let a front frame be the present frame 
in time [ an initial profile setting frame ] (S31). The profile of the following frame is 
copied to the present frame in time (S32), and a profile is completed as the 
boundary of an object like S3 by making this copied profile into an initial profile 
(S33)7 AftVr being cb^ the" present frame judges whether it 

is a start frame (S34). If the present frame is not a start frame (S34), a front 
frame will be used as the present frame in time (S31), and subsequent 
processings (S32, S33) will be repeated. When the present frame is a start 
frame (S34), it means ending the tracking to a start frame. 
[0045] Drawing 12 shows the example of mask data acquired by this example to 
image data as shown in drawing 38 . Supposing a frame F13 is an initial profile 
setting frame, the mask data of frames F14-F16 will be obtained by the tracking 
to a frame, and the mask data of frames F11 and F12 will be obtained by the 
tracking to a start frame. 

[0046] Drawing 13 shows the 2nd operation flow chart of this example. Here, 
processing is started from a start frame. Namely, an initial automatic profile 
setup of the same contents as S2 is performed by using a start frame as the 
present frame (S41). And an initial automatic profile setup is performed one by 
one to the following frame in time until it reaches just before a frame (S42) (S43, 
S41). 



[0047] And if an initial automatic profile setup is performed to the frame in front of 
a frame (S42), the result of each frame which performed an initial automatic 
profile setup will be compared, and an initial profile will choose the frame nearest 
to the boundary of an object as an initial profile setting frame (criteria frame) 
(S44). In the selected initial profile setting frame (criteria frame), an initial profile 
is completed as the boundary of an object by the same processing as S3 (S45). 
[0048] The tracking to a frame is performed from an initial profile setting frame 
(S46), the present frame is returned to an initial profile setting frame (S47), and 
the tracking to a start frame is performed (S48). It is clear that the tracking to a 
start frame may be performed before the tracking to an end frame. 
[0049] Drawing 14 shows the 3rd operation flow chart of this example. Here, 
processing is started from a start frame. In drawing 14 , once an initial profile is 
completed as the profile of an object with each frame, the result is seen, and an 
initial profile setting frame (criteria frame) is determined, and the tracking to a 
frame and the tracking to a start frame are performed. 

[0050] An initial automatic profile setup of the same contents as S2 is performed 
by using a start frame as the present frame (S51), and an initial profile is 
completed as the boundary of an object like S3 (S52). And convergence of an 
initial automatic profile setup and a profile is performed one by one to the 
following frame in time until it reaches just before a frame (S54) (S53, S51 , S52). 



[0051]-And if initial automatic profile setup and convergence of a profile are 
performed to the frame in front of a frame (S54), the profile convergence result of 
each frame will be compared and an initial profile will choose the frame best 
converged on the boundary of an object as an initial profile setting frame (criteria 
frame) (S55). The tracking to a frame is performed from the selected initial profile 
setting frame (criteria frame) (S56), the present frame is returned to an initial 
profile setting frame (S57), and the tracking to a start frame is performed (S58). 
It is clear that the tracking to a start frame may be performed before the tracking 
to an end frame. 

[0052] Drawing 15 shows the 4th operation flow chart of this example. Here, 
processing is started from a start frame. The same initial automatic profile setup 
as the contents shown in drawing 3 is performed to the present frame (S61), and 
an initial profile is completed as the boundary of an object by the same 
processing as S3 (S62). And the tracking to a frame is performed (S63), after 
that, the present frame is once returned to an initial profile setting frame (S64), 
and the tracking from an initial profile setting frame to a start frame is performed 
(S65). In the 1st time, since an initial profile setting frame is a start frame, S65 is 
not performed in fact. By the processing so far, by the case where a start frame 
is used as an initial profile setting frame, the object of all frames is able to be 
extracted and the object extract result of all the frames is saved in memory 



temporarily (S66). 

[0053] S61-S66 are repeated by using the following frame as the present frame 
(S68) in time until an initial profile setting frame turns into a frame in front of an 
end frame. That is, the boundary of the object of each frame at the time of 
^arr^ng"ouTan initial automatic" profile setup to each frame to the frame in front 

of a frame is able to be extracted from a start frame. This number of sequences 
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is a frame number -1. In the example shown in drawing 38 , since a frame 
number is 6, five object extract results of all frames will be obtained. 
[0054] The optimal thing is chosen from the extract result saved in memory 
temporarily, and let it be a final extract result (S69). 

[0055] Drawing 16 shows the outline configuration block Fig. of the 2nd example 
of this invention. A picture input device 30 consists of a video camera, picture 
reproducer, etc., and inputs a dynamic-image signal into memory 32. Memory 32 
stores temporarily the dynamic-image data inputted from a picture input device 
30 by several frames. Motion detection equipment 34 detects the amount of 
motions of each part on an attention frame from the image data of two or more 
frames memorized by memory 32. Block sort equipment 36 classifies each block 
on an attention frame into a part for a background, and an object part according 
to the detection result of motion detection equipment 34. 

[0056] Similarity (or whenever [ coincidence ]) detection equipment 38 judges 



the similarity -of the block classified according to block sort equipment 36 by 
inter-frame, and the image selecting arrangement 40 chooses the high frame of 
similarity, and it uses the frame as an initial profile setting frame. 
[0057] The profile setting device 42 sets an initial profile as the boundary of a 
part for a back^TTnd^^nd an object part usiFg"The"classification result of block 
sort equipment 36 to the initial' profile setting frame chosen with the image 
selecting arrangement 40. Profile convergence equipment 44 converges the 
initial profile set up with the profile setting device 42 so that the actual profile of 
an object may be met. 

[0058] A convergence result is transmitted to the profile setting device 42 
through memory 32, and serves as an initial profile of the frame which should be 
processed next. Profile convergence equipment 44 converges an initial profile 
on the actual profile of an object like the point to this frame. Finally the profile in 
all frames is obtained by performing this processing even with a frame from an 
initial profile setting frame in the both directions from an initial profile setting 
frame to a start frame. 

[0059] The profile display 46 displays these progress and a result. Thereby, a 
user can check progress and the final result on a screen. The image output unit 
48 outputs the result obtained by doing in this way as border-line data or mask 
data in which the inside and outside of an object are shown. 



[0060] Drawing 17 shows the operation flow chart of the example shown in 
drawing 16 . Automatic selection of the frame which sets up an initial profile out 
of all frames is made (S71). An initial profile is set up by automatic processing to 
the selected frame (S72), and it is made to converge on an actual profile (S73). 
A dynamic T contour model is used for convergence of a profile. If it is completed 

by the profile and agrees in the configuration of an object, it will complete and 
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then the processing in a frame will shift to inter-frame processing. 
[0061] The tracking to a frame is performed by using an initial profile setting 
frame as a criteria frame (S74). Then, the present frame is returned to a criteria 
frame (S75), and the tracking to a start frame is performed (S76). It means that 
the object was extracted from the start frame with all the frames to a frame by 
this. Of course, the result is the same even if it performs the tracking to a frame 
from a criteria frame, after performing the tracking from a criteria frame to a start 
frame. 

[0062] Drawing 18 shows the detailed flow chart of automatic selection (S71) of 
an initial profile setting frame. Processing is started by using a start frame as the 
present frame. First, the present frame is divided into a block (S81), and the 
amount of motions of each block is computed (S82). the approach by which this 
is generally known as pattern matching of a block - each block - the following 
frame ( drawing 5 ) — it is the processing which asks for which location is 



supported and-asks for which has shifted from the same location on a screen for 
every block as a motion vector, the performance index of matching — for 
example, the difference during a block — a sum of squares or difference — it is 
the absolute value sum etc. 

[0063] If a motion vector can be "found to all blocks, each block will be classified 
according to the value of a motion vector (S83). The characteristic quantity of 
this frame is calculated and saved from a classification result (S84). The 
classification approach and the calculation approach of characteristic quantity 
are explained in detail later. 

[0064] The above processing (S81-S84) is repeated until processing of (S86) 
and all frames will finish like the frame whose number is two, and the frame 
whose number is three (S85), if the characteristic quantity of the 1st frame is 
calculated. 

[0065] If processing of all frames finishes (S85), the frame to which characteristic 
quantity is similar from each frame will be detected (S87). A frame with the 
highest similarity is chosen and let it be an initial profile setting frame (S88). 
[0066] Convergence (S73) of an initial automatic profile setup (S72) and a profile 
is explained in detail. The easiest method of setting up an initial profile 
automatically makes the boundary of the block classified into the object an initial 
profile. In this case, it depends for the precision of an initial profile on the 



magnitude of a block. As the -example shown in drawing 1 explained, the 
dynamic contour model called SUNEKUSU can be used for convergence to the 
set-up actual profile of an object from an initial profile. 

[0067] Drawing 19 shows the detailed flow chart of the tracking (S74) to a frame 
from an initial" profile setting frame. Let the following frame be the present frame 

in time [ an initial profile setting frame ] (S91). The profile of a front frame is 
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copied to the present frame in time (S92), and a profile is completed as the 
boundary of an object like S3 and S73 by making this copied profile into an initial 
profile (S93). After being completed by the profile, the present frame judges 
whether it is an end frame (S94). If the present frame is not an end frame (S94), 
the following frame will be used as the present frame in time (S91), and 
subsequent processings (S92, S93) will be repeated. When the present frame is 
an end frame (S94), it means ending the tracking to a frame. 
[0068] Drawing 20 shows the detailed flow chart of the tracking (S76) from an 
initial profile setting frame to a start frame. Let a front frame be the present frame 
in time [ an initial profile setting frame ] (S101). The profile of the following frame 
is copied to the present frame in time (S102), and a profile is completed as the 
boundary of an object like S3 and S73 by making this copied profile into an initial 
profile (S103). After being completed by the profile, the present frame judges 
whether it is a start frame (S1 04). If the present frame is not a start frame (S104), 



a -front-frame will-be used as the present frame in time (S1 01), and subsequent 
processings (S102, S103) will be repeated. When the present frame is a start 
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frame (S104), it means ending the tracking to a start frame. 
[0069] Next, the characteristic quantity of each frame is explained. As 
~^aracteristi^ histograrrTof a rnotioTT vector, the histogram of a block 

sort result, etc. can be considered. Procedure is explained with reference to the 
operating sequence shown in drawing 21 , and the flow chart shown in drawing 
22 . In drawing 21 , five processing objects are F21-F25, F21 is a start frame and 
F25 is an end frame. 

[0070] A frame F21 is divided into a block as shown in drawing 23 (S1 11). One 
frame is divided into 7x5 blocks in drawing 23 . The amount of motions of each 
[ these ] block is detected (S112). Since there is no motion relative between 
frames F21 when a frame F22 is used as a reference frame, a uniform motion 
vector, i.e., the vector of the amount zero of motions, is detected altogether. 
Drawing 24 shows the distribution map of the detected amount of motions. The 
block of a slash shows the block of the amount zero of motions. 
[0071] Next, a motion vector is classified (S113). With a frame F21, by all blocks 
moving, since it is an amount 0, an object block should be detected and all are 
considered as a background block. The number of object blocks (here zero) is 
saved as characteristic quantity of this frame (S1 14). 



[0072] Drawing 25 -shows the detailed flow chart of processing of S1 13 and S1 14. 
A motion vector is classified for every occurrence frequency (S121). The block 
used as a background is determined (S122), and the block used as an object is 
determined (S123). For example, make into a background what has most block 
coiJnts,^n"d1et the second be an~6bject. Or the location or distribution in which a 

block exists may determine a background and an object. When classifying only 
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into two kinds, a background and an object, the same result is brought even if it 
asks for another side from one side by subtraction from the total block count. 
The number of object blocks is saved as characteristic quantity of this frame 
(S124). 

[0073] It divides into a block by using the following frame F21 as the present 
frame (S 11 6) (S111), the amount of motions is computed (S112), and each 
block is classified (S1 13). 

[0074] Since the frame F22 is the same as a frame F21, the situation of block 
division of it is the same as that of drawing 23 . However, since the frame 
referred to in case it asks for a motion vector turns into a frame F23, a relative 
motion arises. That is, it moves by part for a background, the vector of zero is 
detected, and it matches with the place moved rightward by the object part 
toward the screen. When a part of object and a part of both of a background are 
contained in the block, the completely same block as the frame to refer to does 



not exist. 

[0075] When a threshold is prepared in the performance index of matching and 
the low block of whenever [ coincidence ] is excepted, as shown in drawing 26 , 
a background block, an object block, and the boundary block containing both' a 
background and an object are searched for. In drawing 26 , the blocks of a slash 
are [ a background block and the block of void ] boundary blocks, and the block 
of a crossover slash is an object block. At this time, the background block count 
is [ 5 and the boundary block count of 19 and the object block count ] 11. 
[0076] When not adding a limit to evaluation of matching, it is together put by two 
kinds of motions. Drawing 27 shows the mimetic diagram of the classification 
result. The blocks of a slash are [ a background block and the block of a 
crossover slash ] object blocks. In this case, a boundary block is also classified 
into any of a background block or an object block. 29 and the object block count 
are set to 6 by the background block count in the example shown in drawing 27 . 
[0077] The object block count 6 is saved as characteristic quantity of a frame 
F22(S114). 

[0078] If the object block count of each frames F21-F25 is saved as 
characteristic quantity of each frame (S115), whenever [ the block count's 
coincidence ] will be judged (S1 17). For example, the object block count of each 
frames F21-F25 is compared, and the block count asks for the same frame. In 



-the example shown in drawing 21- r since a -frame F22 and the amount of motions 
between F23 are large and a frame F23 and the amount of motions which it is 
between F24 are large similarly, the block count it is considered that is an object 
block takes a near value. It moves between a frame F24 and F25, and since 
fhere"^e~few amounts, "possibility that the block count the sharpness of 

separation of a block falls and it is considered that is an object block will become 
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small is high. From these things, it is judged with the block sharpness of 
separation of a frame F22 being high. Let a frame F22 be an initial profile setting 
frame according to this judgment result (S1 18). 

[0079] Then, it continues with an initial automatic profile setup (S72) shown in 
drawing 17 , and convergence (S73) of a profile. When convergence (S73) of a 
profile is completed, the mask data shown in drawing 28 with a frame F32 are 
obtained from a frame F22. And by the tracking (S74) to a frame, the mask data 
shown in frames F33-F35 are obtained, and the mask data shown in a frame 
F31 according to the tracking (S76) to a start frame are obtained. It means that 
the mask data of all frames were called for by the above. 

[0080] In drawing 25 , although the object block count was saved as 
characteristic quantity, it is good also considering the background block count as 
characteristic quantity. Moreover, it asks for the ratio of the background block 
count and the object block count, and is good also considering it as 



characteristic quantity. Drawing 29 shows the operation flow chart 
corresponding to the parts of S113 and S114 in the case of making the ratio of 
the background block count and the object block count into characteristic 
quantity. 

[0081]" Itla^ vector of each block 

(S131), a background block is determined (S132), and an object block is 
determined (S133). The approach of making a background what has many block 
counts of No. 1, and making the 2nd an object is simple. What is necessary is to 
calculate whether it is close to which [ the 1st and / 2nd ] vector by distance 
count of a vector, and just to classify according to the result about the vector of 
the 3rd henceforth. 

[0082] The number of a background block and object blocks is counted (S134, 
S135), and the ratio is saved (S136). It is thought that the frames which have the 
block ratio to approximate by this have the high sharpness of separation of a 
block. 

[0083] Drawing 30 shows the operation flow chart which makes area of a block 
characteristic quantity. Except for saving the information on the area of a block 
as characteristic quantity (S1 44), and inter-frame comparing the information on 
area, and judging whenever [ coincidence ] (S147), it is the same as drawing 22 
fundamentally. 



-[0084] Drawing 31 shows -the detailed- flow chart of S144. It asks for the 
occurrence frequency of the motion vector of each block (S151), a background 
block is determined (S152), and an object block is determined (S153). The 
classification (S155) of the block acquired by re-division of a boundary block, 
and (S 154) and re-division is repeated until the classification of a boundary block 

is completed (S156). Drawing 32 divides into the block of 2x2 the boundary 

i 

block (block of void) shown in drawing 26 , and shows the result of having 
carried out reclassification of each block to the background block or the object 
block. By this reclassification, a motion vector may be re-calculated, the motion 
vector of a background and the motion vector of an object which have already 
been called for may be applied, and you may evaluate by which is more 
probable. 

[0085] Like the example shown in drawing 27 , on a classification, when not 
searching for a boundary block, the block which is in contact with the object 
block and the background block can also be considered as a boundary block. 
Drawing 33 shows the re-division result of the boundary block in the block 
division shown in drawing 27 . 

[0086] Drawing 34 shows the division result at the time of performing two steps 
of re-division. It is clear that it can bring close to the area of an actual object by 
increasing the count of re-division. 



[0087] If the classification of a boundary block is completed (S1 56), the area of 
an object block is calculated and a count result is saved as characteristic 
quantity of the frame (S1 57). 

[0088] Whenever [ area's coincidence ], by judgment (S1 47), the area of the 
Object of each fFamfe is measured and it asks for what has a near value. Since 
the degree of separation of a block increase when the relative amount of 
motions is large, it is easy to ask for the area of an object correctly. When the 
relative amount of motions is small, the degree of separation of a block are bad 
and it is hard to ask for the area of a right object. Therefore, with the bad frame 
of degree of separation, the area of an object becomes the approximated value 
in a frame with an area of an object sufficient [ dispersion and degree of 
separation ]. 

[0089] Possibility that two area of the object of F22 and F23 will become this 
near value in the example shown in drawing 21 since the amount of motions 
between a frame F22 and a frame F23 is large and the amount of motions 
between a frame F23 and a frame F24 is large similarly is high. If it is judged 
from these things that the block sharpness of separation of a frame F22 is high, 
a frame F22 will be determined as an initial profile setting frame (S148). After 
determining an initial frame, it continues with an initial automatic profile setup 
(S72) and convergence (S73) of a profile. 



—[0090] In addition, when not performing re-division of a block, the area of an 
object block becomes x (the number of object blocks) (the number of pixels of an 
object block). Since the number of pixels of an object block is fixed, as shown in 
drawing 25 , it becomes the case and equivalence which count the number of 
object blocks simply. 

[0091] When an initial frame is set up, the mask data (here frame F32) of the 

i 

initial frame (here frame F22) are obtained. Therefore, the mask data of a frame 
F31 are obtained by the tracking (S74) to an end frame according to mask-data 
****** of frames F33-F35, and the tracking (S76) to a start frame. The detail of 
tracking is as having explained previously. It means that all mask data were 
called for by the above. 

[0092] Drawing 35 shows the operation flow chart which makes the configuration 
approach of an object characteristic quantity. Except for saving the configuration 
information on an object as characteristic quantity (S164), and inter-frame 
comparing configuration information, and judging whenever [ coincidence ] 
(S167), it is the same as drawing 22 fundamentally. 

[0093] Drawing 36 shows the detailed flow chart of S164. It asks for the 
occurrence frequency of the motion vector of each block (S171), an object block 
is determined (S172), and a background block is determined (S173). The 
classification (S175) of the block acquired by re-division of a boundary block, 



and (S174) and-re-division is repeated until the classification of a boundary block 
is completed (S176). 

[0094] After the classification of a boundary block is completed (S176), an initial 
profile is set automatically on the boundary of an object block and a background 
block (S177), and the initial profile is completed as the profile of an actual object 
(S178). These processings (S177, S178) are the same as processing of steps 
S72 and S73 of drawing 17 respectively. 

[0095] With reference to drawing 37 , it explains concretely. Drawing 37 (a) 
shows the block of the object neighborhood shown in drawing 32 . Drawing 37 

(b) is in the condition which set the initial profile as the boundary of the object 
block shown in drawing 32 (a), and a broken line shows an initial profile. An 
initial profile does not necessarily need to be set to the boundary itself which 
touched the background block, and may connect and set up the middle point on 
the boundary line of a block by the straight line or the spline curve. Drawing 37 

(c) shows the process which the initial profile converges on the actual profile of 
an object. Drawing 37 (d) is the result of finally converging, and its actual profile 
and convergence result of an object correspond. Since it can ask for the area of 
an object in the example shown in drawing 37 more correctly than the approach 
explained by drawing 30 , it is good also considering the area of the object 
obtained by this approach as characteristic quantity. 



-[0096] Some- approaches can be considered in order to save a border line as 
characteristic quantity. It is one of the easiest examples to make a boundary 
length into characteristic quantity, the inside of the ellipse which finds the 
greatest die length among the distance for two points of the arbitration on a 
periphery, or is circumscribed, and area — you may ask for a min thing. There is 

an expression by the fourier descriptor as a complicated example. This has a 

i 

large operation load. However, whenever [ configuration's coincidence ], since it 
becomes possible to perform eternal collating to similarity transformation, also 
when the sequence is carrying out a zoom, it can respond by processing of a 
judgment (S167). 

[0097] Preservation of the configuration information on all frames judges 
whenever [ configuration's coincidence ] by each inter-frame one (S167). (S165) 
That is, the value about the configuration information on each frame is compared, 
and it asks for what has a near value. Since the degree of separation of a block 
increase when the relative amount of motions is large, it is easy to search for the 
configuration of an object correctly. When the relative amount of motions is small, 
the degree of separation of a block are bad and cannot search for the right 
configuration of an object easily. Therefore, with the bad frame of degree of 
separation, the configuration of an object becomes what was approximated in a 
frame with the configuration of an object where dispersion and degree of 



-separation are sufficient. 

[0098] In the example shown in drawing 21 , since the amount of motions 
between a frame F22 and a frame F23 is large and the amount of motions 
between a frame F23 and a frame F24 is large similarly, this possibility of the 
" configuration of the object of F22 and F23 of approximating is high two frames. If 
it is judged from these things that the block sharpness of separation of a frame 
F22 is high, a frame F22 will be determined as an initial profile setting frame 
(S148). Since the profile of this frame is already called for, the mask data of the 
frame F32 of drawing 28 will already have been called for. Then, the mask data 
of a frame F31 are obtained by the tracking (S74) to an end frame according to 
mask-data ****** of frames F33-F35, and the tracking (S76) to a start frame. The 
detail of tracking is as having explained previously. It means that all mask data 
were called for by the above. 

[0099] In both [ in the case where two or more devices realize, and the case of 
one device realizing ] cases, this invention is applied, and it deals in it. 
[0100] To moreover, the computer in the equipment connected with the various 
devices concerned in order to have operated various kinds of devices so that the 
function of the example mentioned above may be realized, or a system The 
program code of the software for realizing the function of the above-mentioned 
example is supplied. What was carried out by making it operate according to the 



-program in which the computer~(CPU-or MPU) of the equipment or a system was 
storied, and operating said various devices is contained in the range of the 
invention in this application. 

[0101] In this case, the storage which stored the means, for example, this 
program code, for the prograrfTcode "of said software itself to realize the function 

of the example mentioned above, and supply that program code itself and its 

i 

program code to a computer constitutes this invention. As a storage which stores 
this program code, a memory card, ROM, etc. of a floppy (trademark) disk, a 
hard disk, an optical disk, a magneto-optic disk, CD-ROM, a magnetic tape, and 
a non-volatile can be used, for example. 

[0102] Moreover, also when the function of the above-mentioned example is not 
only realized by performing the program code with which the computer was 
supplied, but the function of an above-mentioned example is realized in 
collaboration with OS (operating system) or other application software etc. to 
which the program code is working in a computer, it cannot be overemphasized 
that it is contained in the example of invention which requires this program code 
for this application. 

[0103] Furthermore, also when the function of the example which the CPU with 
which the functional add-in board or a functional expansion unit is equipped 
performed a part or all of actual processing, and mentioned above by the 



-processing is realized based on directions of the program code after the supplied 
program code is stored in the memory with which the functional expansion unit 
connected to the functional add-in board of a computer or the computer is 
equipped, it is needless to say in being contained in invention concerning this 
application. 
[0104] 

[Effect of the Invention] According to this invention, the extract result of a simple 
and high precision can be obtained by choosing the frame of arbitration from an 
animation, carrying out automatic extracting of the profile from there, and 
performing the automatic tracking to an order frame so that he can understand 
easily from the above explanation. By choosing the frame of arbitration from the 
initial profiles of two or more frames, the result of convergence and tracking can 
be predicted easily. By choosing the frame of arbitration from the profile 
convergence results of two or more frames, prediction of a tracking result 
becomes easy. The optimal thing can be chosen out of an extract result by 
holding the result of having performed the automatic extracting of a profile, and 
the automatic tracking to an order frame, to two or more frames. 
[0105] The automatic selection of the initial profile setting frame can be carried 
out by the simple approach by making the block count, area information, or 
configuration information into characteristic quantity. A full automatic object 



-extract -is attained-by performing the-automatic extracting of a profile, and the 
automatic tracking to an order frame from the frame. 



DESCRIPTION OF DRAWINGS i 
[Brief Description of the Drawings] 

[Drawing 1] It is the outline configuration block Fig. of the 1st example of this 
invention. 

[Drawing 2] It is the operation flow chart of the example shown in drawing 1 . 
[Drawing 3] It is the detailed flow chart of an initial automatic profile setup (S2) of 
drawing 2 . 

[Drawing 4] It is the example of an object frame of an initial automatic profile 
setup. 

[Drawing 5] It is the next frame of the frame shown in drawing 4 . 

[Drawing 6] It is the mimetic diagram showing the processing middle of an initial 

automatic profile setup. 

[Drawing 7] A block and boundary block of the object to the first block division 
are shown. 



[Drawing 8] A block and boundary-block of the object after carrying out block 
division again and classifying a boundary block in the example shown in drawing 
7 are shown. 

[Drawing 9] It is the mimetic diagram showing the processing middle of an initial 
automatic profile setup. 

[Drawing 10] It is the detailed flow chart of the tracking (S6) to a frame from an 
initial profile setting frame. 

[Drawing 11] It is the detailed flow chart of the tracking (S8) from an initial profile 
setting frame to a start frame. 

[Drawing 12] It is the example of mask data acquired according to the example 
shown in drawing 1 to image data as shown in drawing 38 . 
[Drawing 13] It is the 2nd operation flow chart of the example shown in drawing 
1 . 

[Drawing 14] It is the 3rd operation flow chart of the example shown in drawing 1 . 
[Drawing 15] It is the 4th operation flow chart of the example shown in drawing 1 . 
[Drawing 16] It is the outline configuration block Fig. of the 2nd example of this 
invention. 

[Drawing 17] It is the operation flow chart of the example shown in drawing 16 . 
[Drawing 18] It is the detailed flow chart of automatic selection (S71) of an initial 
profile setting frame. 



- - [Drawing -19] It is the detailed flow chart of the-tracking (S74) to a frame from an 
initial profile setting frame. 

[Drawing 20] It is the detailed flow chart of the tracking (S76) from an initial 

profile setting frame to a start frame. 

[Drawing 21] It is an example of an operating sequence. 

[Drawing 22] It is the more concrete operation flow chart of the example shown 

i 

in drawing 16 . 

[Drawing 23] It is an example of block division. 

[Drawing 24] It is the distribution map of the amount of motions detected to the 
division block shown in drawing 23 . 

[Drawing 25] It is the detailed flow chart of processing of S113 and S114. 
[Drawing 26] It is the block part similar case of a background block, an object 
block, and a boundary block. 

[Drawing 27] It is the block part similar case of a background block and an object 
block. 

[Drawing 28] It is an example of mask data. 

[Drawing 29] It is an operation flow chart corresponding to the parts of S1 13 and 
S114 in the case of making the ratio of the background block count and the 
object block count into characteristic quantity. 

[Drawing 30] It is the operation flow chart which makes area of a block 



characteristic quantity. 

[Drawing 31] It is the detailed flow chart of S144. 

[Drawing 32] It is the result of carrying out block division and carrying out 

reclassification of the boundary block shown in drawing 26 . 

[Drawing 33] It is as a result of [ of the boundary block which can be set 

comparatively ] re-division a blocked part shown in drawing 27 . 

[Drawing 34] It is as a result of [ at the time of performing two steps of 

re-division ] division. 

[Drawing 35] It is the operation flow chart which makes the configuration 

approach of an object characteristic quantity. 

[Drawing 36] It is the detailed flow chart of S164. 

[Drawing 37] It is the example of a convergence process of a profile. 

[Drawing 38] It is a mimetic diagram explaining a motion of the object of each 

frame in an animation sequence. 

[Description of Notations] 

10: Picture input device 

12: Memory 

14: Motion detection equipment 
16: Block sort equipment 
18: Profile setting device 



20: Profile convergence equipment 

22: Profile display 

24: Image selecting arrangement 

30: Picture input device 

32: Memory 

34: Motion detection equipment 

i 

36: Block sort equipment 

38: Similarity (or whenever [ coincidence ]) detection equipment 

40: Image selecting arrangement 

42: Profile setting device 

44: Profile convergence equipment 

46: Profile display 

48: Image output unit 
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of ComputerVision, Vol. 
30 1, No. 3, pp. 321-331, 198 
8) c 

[0007] x^-^xtt> ^mimm^tirct^ic 

^-MSSfti. x-y^^Ji^SiJi^£Dy1.gpx*;l/^-i:)t 

6A^so»jttT?J6*rtajx*^-o«8eai-e«***i 
[0008] x*-*x*jgfflfs»i:«, ttdiwaoii 

So 

[0 0 0 9] 

50 § 0 S/c, *rs?x^ hWOj&'WRfeSr^-pu^SIB* 
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[00 10] 3>t!a-^'*77^7^XRrf7-)< 

[ooi i] i«sifr6*7^xi' h*am-r**j* 
cgui (^77-rA;i" a.— if • -fy*-7i-x) 

[0012] coaw*iifi»-r*fc«s 

-Art©feRtfx*X**©tt$H(cftn*.x 7\s—L.m<D 

[0 0 13] 03 841^T, C<OHffi#<fct>f¥L<iB 
ft5o 13 8(1 Siil->-'7->'X(c*5tt-5#7l'-A 
O*^x^K0ft**KWr*«^CHT»J6*. Fl~ 
F 6«l$WWfc:igi|&r£:7U-AT'&»K 7U-AF 1 
^7>?-h7b-A, 7b-AF6A^l>H71/-LT 
ftZt-fZo X^-l-7l/-AF 1 t J E-03!07U-A 
F 2 k«\ *£¥ffcfttWS#fc&S)LT^fc^iIMF , 9© 

- A 6 Hi IT ft «4ft tb L <fc b t L T t, (f R © 1ft # * 7 
S?x^ hOlftfetflfOCTi&So C©i:£tcti, *7"^x 

LTv>s«teT*, *>i5*y<:/Lfcfctrfc:fcEli;|gS»<: 

[0 0 14] 05S7U-A*BH$7U-AT«:<, 7U 
-AF4©<fc?&, «fHW(C(jtnfc7U— Afcftltf, 

ffctttfStSo Ub>U tout, «ftra±o»(S&'tf 
^ini±o»«L<4t), 

*Hc<<%5„ ctitt, H*nMMtfH<fc. Jgtf^fttf 
**<**BIft6tt«<*^6-P**. ffi?T, X*-h 
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/o 

[0015] nicgufKifemzmzrcibici,^ nmt* 
$rn.o«\ ?<D7 is-i±%mmt. LT$m?5ftic 

[0016] *^«x c©j:'3&rmi5ic**, a- 
*r mfto&m&'p* <. * o im k. * 7 s> x * i- *««a ■ 

[0 0 17] 

P., H^<D7l/-A«:iKt57sf7 7't> Sf&StRL 

[0018] *mwicm%wmmmy5m&%rc. m$H7 
SRawsnfc^i'-Aosw! 

<t t> t>mmmcffiRzr&(D7 u- Afcisjtt?* 3 ct* 

[0 0 19] #?§HJ§tc^Sffl&®Jl73&(±3:fc. SiSf^ 

u-Atcj; o^ifig^nsi&ia^-^©^ u— A»c*t 

LTW«lli%M-r§Xf7 7*t, ISS7U-AC 

40 SISlR*$n«:S7U-AflD(i$P<Otfi*>e)^©7 
b-A4I«t5Xf77"i:, SBBfflKSnfc^l'-A 
O*M?iR*OtS*t»^^Tflfi<07U-AK»LTaBi 

mm{&<D7\s-L.£LTmmmtRLrc7i'-j± 

[0 0 2 0] *%IBlCtt«Htta9«i£<i*fc. ffiSt^ 
U-Atc J: 0«J«?n5IftH«7 f -^O^7 AfC« 
50 LTSlffiiS^MtSXfyT'i:, ii§7b-^ 
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[00 2 1] #£Wfc«Sfe«!«f*»cl4> ±2EOHfl&} 
5. 

[0 0 2 2] JejfflHlcflteHfMaaSWti:. 

[0023] *¥zmic&zwmmmmmt&tz. mmy 
otmimtittu s«MWira#«K:J:t>aBHKj£ 

[0 0 2 4] *f£^t^SH««lS^Bt±Sfc, *»7 
U--MC4 »)««Stl*»H»7*— U-AK*f 

[0 0 2 5] *^WK^Sffi«ffllS^B«Sfc, «»7 



(7) 9$SfJ 2002-56393 

l/-AOin)IHII*B*aKaffi*fftOllW»i:iRj|?S-a:*t» 

OUXJWSjRO.*^ 6 WjeolMMErWW- SItRfgi: * 
[0 0 2 6] 

[0 0 2 7] 01 tt, *fP.8©Sg 1 ^fiSCTOM^MfiScT' 

tfB««£tt«ft H*» 6 * tK ifflttHt^* «'J 1 2 
tcA73-r?>o ^tU 1 2tt» lS^A77^Ml 0frP>A*J 

ttbgn 4 a, ^ty'i 2fcfstt?ns«Sf<07^- 

4 <0fclM8*K:«£i/\ ai7b-A±OS7n7 75;f 

mm&t*7'iSx.* h»»»c««-r*o niBts^SB 1 

[00 2 8] ttffilBBK&IB 2 0 14, $tiq5K5£^B 1 8 T* 
3 J: 5 MX*"*-*. iRjRLfett*«» 1 2*ttb 

*Rgfi2 4tc<fet)ag7b-A^^MUTIif|5llxm^« 
[0 0 2 9] ffiTJ. *W»RJWS«3^»JE"P**«,<0"Pa& 

-i*tffci£?zk. mm&mmi 8««, i*7i--i 

OiRJWe*«:l»»7U-AO«]flBliWkLTKBeU ft 

iRli:, h7U- AK|Pl^-57j[6]<OM73lRlT*Jltf'r 

Bi^til73^«2 6tt, C<04 5 lc LTJ#e>n 
fc*£m*. IWIWx-i'Xtt. *7-7x7K0rt?i^ 
f7X^f-^t LTtUTj-ri-o 
[0 0 3 0] 0214, *^SSCT<Oi!j{t7a-f 1 + -l-^ 

*as?-r* (s i) o aa?Lfc-7u-AK*fLT£EMa 

aT'^JW^SP^S^L (S2) , $£QtMUCiR*?'& 
§ (S3) o fifl5<OiR^lc(4, Di^MfflS^^U^rffl^ 

a. iRmsmciass-e^ft^ntf (S4) , wmmnm 

50 S7U-i,^SiJ<D7W-Atc^MLT, «9fflltmS£^ 



-7- 



(8) 



IS 2002-56393 



13 
(S 2, 



14 



s 3) o-mmmmis.-? 



. 

[00 3 1] nmcDlEl.%i&mtfffiS.T<Z2>iM'& ( s 

4) , wmmmmmy\s-i±%mmyu-L.ti,T, x 

> F7 TO h 7 7 ^V^^ff t5 (S6) o 
■y^V^^T-T^ (S8) „ CMC**), x ^_ h7 

X £ - h 7 Z» £ T- CD h ^ -y * ;/ *"*figff L fc&fc , 

[0 0 3 2] H3(±, 0 2©iibWW«fPS^ (S 2) 

[0033] M7V-A (El 4 ) 6 tcjjVT <fc 5 fc 20 
Wi7£y<<X<D7-ay7lcftmV (S 1 1) , S7n^ 
©tb^fi^ai-r^ (S 1 2) o CtUi. -ASK, 7u 
•y — > LT£ae.nTi^373?£{;: «fc 

#7D7^*^<D7b-A (0 5) HflMuBKttJS 

[0 0 3 4] ^TOya-y^lC^LKt^^ h;b*^S 

Wl/CDfilCjSDT&^n-y ^SrfrlS-fS 30 
(S l 3) 0 0 4Stf0 5^-r^JTfi, WSA" 5 ®®^ 



* •[ 0 0 3 5 ] fcf£U 7D -y ^^WSgP^^^^'x * 
"T SM^*46^> C t tfT'Z&WT, II7"P >y ^ t 

^ b<0^*d -y ^tff07D -y ^OW^7"D -y 
a&3£#*.5„ iS7"n >y ^tcKLTti. Hfi. 7*n-y 
*#fiJSrfT&V\ £9/h£^*#£©:7"D-y*T«flg|5 

6 spurns tftgfo 

[0 0 3 6] 0 7 it, mm<D7~vyy-ftPHc*i?5,*y* 
^ KD7D 7 ^ til?7D 7 f^t. @8(i, 0 

7 tc^-rMT-o^w^D -y tttnmyu «y 

L/:W7>'*x7 htD7n7^i:«W7"n7^^ 
To 

[0 0 3 7] 7D7 7»«^7L/i6 (S I 3) . * 

7i7x.?\~<D7x3 -y ^msmnyu >y? hmmyv -y ? 
9«, ®3ZLrcmmm$$£*y'i?*? bvmmtznte 

[0038] m&Lrzinmi&nttnt&<D*7'i?x.t b(D 
(x, y ) ±-c% mjt&m?2km$ti2>m$$ immm) 

v(s)=(x(s).y(s)) 
<IU 0^s^ 1 

«\ TteiC ( 1 ) T-Si?n5x*;^-|B»i'Nt 
-T3J:5fc:SJ£U x^l^-^/MKfgirLT^JB 

[0 0 3 9] 

mil 



Esnake(v(s» =9 1 (Eint(v(s)+Elmege{v(s))+Econ(v(s))ds (1 ) 
Oo 

Espllne(v(s))=-i{aV(s) 2 + pv(s) 2 } 
2 

Eedgo(v(s))>=-j Y l^l (v(s))| 2 



(2) 
O) 



{1U E i n t {ifia$x*;l/^— , E image t±!Hf 
x^;l/^-, E c o n&ftglSxiM/**— T-&3<> E c o 

[0 0 4 0] E i n t »C(±, ^<<D^tC, ^©^5, 
(2) ic^tE s p l i n etfffl^6n 

5o v- (s) , v" (s) (i^n^n, v (s) ©i 



50 



S„ E s p 1 in e<D§'Nfc»CJ:t), X*— ^Xtirte> 

[00 41] E image iffi^©)®^ I ( v 

(s) ) 5:ffl^tSi?n5S (3) IC5VTE edge 
*^<ffl^^e>n^o Eedgeli, i!i)g^SB©7c€$^ 
mto X^.-i7Xt±, E e d g e©«/Nbtc«i: 0X7 i? 
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[0 0 4 2] ClS T*0*£UIT% 8J»!lft«H5£7 U- A 

[0 0 4 3] 0 1 ott. »JW«ifPI9:S7U-A^6x> 
F71/-AST*iDh77^^ (S6) <Dl¥$S&7D- 

71/^I71/-Ai:tl) (S 2 l) o RSfHWlcfiutf) 
7b- AO«WB*S7U— AtC3lf-U (S 22) , C 

y^x^hoaiffcltffSrlR*^** (S 2 3) o ftffi 
jWBBKLfcSL 17 b-A^xy K7 U-Afrgrfp^J 
£T£ (S 2 4) o 17 x> K7 

tltf (S 2 4) , ^F«:^7l/-L%l7b-Ah 
L (S 2 1) . UK0tt9 (S 2 2, S2 3)*»0iB 
"To I7U^AtfxyF7l/-iiOi|^ (S2 4) , x 

[0 0 4 4] HI lit. «JK8«ISBI93£7U-A^6X^ 
-h7l/-A$T'Oh77^y^;(S8) <D§¥*ffl#7n 
-f^-h^f. W«Blt»»S7U-AO«FBI«U:ailf 
07U-ix«r^7U-Ai:'rs (S3 1) o «Pffl«tC^ 
c07U-AO«$B%3K7l^-A^ne-b (S3 2) . 
C03tr-UfcH»*lB«BliWi:LT, S 3 ^IBJ^tC 
^^x^hoaWfcUffSriR**** (S33)ol 
»jWK*L;fe8L l7l/^AtfX?-h7U-A*^ 
(S3 4) o l7U-ixtfX*-h7U-A 

r-fctttuf (S3 4) , mmmcm<Dyu-^myu 

-A£ t (S 3 1) . &J&(Dmm (S 3 2, S33) % 
Si^jg-fo 87U-W^*-h7l/-AO«§ (S 3 
4) , X^h7l/-AST*©h77*^*«7Uc 

[0 0 4 5] H'l2tt, ^38 ic^tk b fcllHS-r— * 

?o 71/-LF 1 3#8«i«W7l^ AT'^fct 
xy K7V-A^TO h 7 7^y^'7 F 
1 4-F 1 6<D^X^7 ? -£;W§'Dns X?-h7U- 
A£T*Oh^y^>^T*7U-- AF 1 1 , F1207X 

[oo4 6] mi 3&< *nmm<Dm2<Dmv£7u-?- 

-V- h^^Tc CCTit X*— F7U— Afreflia* 
(S4 1) o x>K7U-A^tttutcIiM-r^^T* (S 

42) . »iHttfc*o7u-Aicj*b)Kfc. mmwmm 
mmjzzmfiTz (s 4 3. s 4 1 ) o 

[0 0 4 7] XV K7U- A<DHfu<D7U— A£T£S!j 
»WHWRffi«:*fTLfe6 (S4 2) , glfr^JSiliEK 
5£**fTLfc*7U-AO*g»*J±ttU 
T^x * F toh fe>fi^7 1/- A«rfl3ffiftff K 
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S71/-A (S¥7i/-A) t-LrajR-rs (S4 

4) o m^1tWmeKKSL7V-U (l¥7l/-A) 
tc*5i,>T. S 3 fcn«OiDa»cj:0«I»!*l»**^x 
*F©*JWciKJK*-»S (S4 5) 0 

[0 0 4 8] «JW*iSBK^7U-A*>e»x>K7U-A 
$T'©h77^>^»TL (S4 6) . Sl7lx-A3: 
«WWJMa«7U-Ak:B?UT (S 4 7K X^r~h7 
U-A$T©h77 + >^HfTt5 (S4 8) o X* 
-h71/-LSTOb77^>^xy F71/-LST 

[0 0 4 9] BMIi; #*ffi0JO^3OBM^7n-f- 
F*35VTo CCT'k X*— F7U— Afr&iKI* 

n»w*o 014m -a, *7u-A"eawii«* 

W«a3E7U-A (S*7U-A) «rtt^U X>F7U 
-ASTc0h^^^>^&r/X^->7U~A^TOh 

[0 0 5 0] h 7 U-^17 l^Ai: LT; S 

20 ztmrnvftnosmmmffimmfe^fiL (ss 

<££i±& (s s 2) o ^>F7u—j±<Dm.mc§mirz> 
$r* (S5 4) . msmc&(D7u-i±ictti,m^ § 

»a»lt»H)e4:lt9P<DiR*«:llfTr* (S 5 3. S5 
1 , S 5 2) o 

[0 0 5 1] xVF7U-AOiSmj<07U-A*"C ? SIft 
^W^^StffiWOiR^^Tbfce> (S 5 4) , 
*7U-AO«IWiRWtS**lt«U »WIM?*«*^^ 
x * F <DiHWtc fe o £ fe a < iRlK LT^5 7 A«rSJ 

(S 5 5) o 3!«Lft*!J)Hli9l9ft3t7U-A (31* 7 U 
—A) ^f>x>K7L/-AST^h^^^>^HtTb 

(S5 6) . m7is-2±*mmmnmm7\s-<LicmL 

T (S 5 7) , 7?-h7U-ASTOh77*>^% 
^frT3 (S 5 8) o X^-h71/-A$TOb77^ 
V ^«rx yK7L/-ASTOh77 *l/V<omz-Wri b 

[0 0 5 2] HI 5tt, *^«6fiW0^4<0«|f¥7n-^ 
^-h^-To llT^, X*— h7U— A^^jaa* 
40 BflMrTSo Si7U-Afc:JtU H3tc^-Trtg^fl]Ue 

»«JWIt»HS**ffL (s 6 i ) , S3 h^SlcojaJi 
T«WlfiW**r^x^-hO«lfK:iR5RS^S (S6 
2) o XVF7U-A£T*<DF^-y*V^^£fTL (S 
6 3) % *<D'&, l/^fcA,a7U-A*ffl«HltWH«7 
U-AfcRL (S64), «JWHW»Be7U-A^6X' 
*~h7U-A£T*Oh^>y*:y^&|gfT^£ (S6 

5) o lSim 4BWItWI»e7U-A^X*-h7 

u-AT*fe^<or% s 6 5&nmc&mn~$ti&*<\ c 

C£X*(Dmm-C\ X*-F7UW>*S»8I£WK;£7U 
50 -A£ Lfci§^t\ £7U-AO*:7^x* h^T' 
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=e 'j Bf<£frr s ( s 6 6 ) „ 

[00.5 3] ^ftfP^^U-A^xvK^U—Aco 
7U-At Lt (S 6 8) , S6 1~S66^0jE 
ilH9<07 I/- A3: T'CO^&7 V- Afcfcf l_T iK«0^$ft$P 

- 1 T'fe^o 0 3 8 fcaVrWT'Wu 7 U- Agftf 6 T'fe 
3<DT\ ^U-LOt/^i^ htttti*£Stf5C>i§e> 

[00 5 4] ^^&'JlC-B#«#UfctttBif£^P,«ji^ 
fcO^jglRU ^n^S*?^»HJ^mi:t-S (S 6, 
9) o 

[o o 5 5] m i 6 it, ^m<r)mzmmm<ommmm 
[0056] (x«-SfS) &mmw3 8iz. y 

a -y ZftmmW 3 6 T*»i?tlft7"D •y *<Dmi&,®L*7 
U-AF^t«L> HHUgiRgffi 4 0A^«S«iS^7 

i:TS<, 

[0057] mmmfemw 4 2 mmmmmm 4 0 -e 

3S«2nfc*7J^figq5K£xb-AU:ttU 7n7>»S 

^g3 6<DttmteHk*mmLT. mm^t^ry^^^ 

[0 0 5 8] iKm^Sti, **V3 2^LTHI]5^ 
£ffi4 2Ki&3M£*U #lCffiIi^#:7U-AC9MIE$i 
IBfcfcSo iSiBiR3KgB4 4tt, AlcftLT 

-AfT'i:. I0MMS7 U-AA^X^ - h 7 U- 

[0 0 5 9] $£|q5S^gg4 6«, cne.<DiSilSt) : ^ 
^^Hffi±T'6II2T-t5c H{£ttj;ftSB4 8li. C 

[00 60] 01 7li< @1 6 lC7jk?M1&m<DmiF7 a 
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/S 

-^• + -h^-To ±7U-Ac94>:fr£SJ$$t«SrIS;« 

-rs^b-A^etds^-rs (S7 n „ mmztitcy 
2) , n^mmzmiz^z (s 7 3) „ fti^iKJE 

[0061] mmmmm^y u-A%mmy u— a t l 

T, x^H^U-AST'^h^^ + ^^HtT-rS (S 
/0 7 4)o ^7U-A^SJp7U-AtcMLT 
(S7 5) , X^- K^l^-A^T-cDh^-y^^^ll 

trrs (S7 6) o cmc^tu xz— by v—i±fr<b 

l> K7 l/-ASfOi7 1/- Aft/i/'x ^ btfttffi 
^n/cCtlc&So ^H. S*P:7l>-Afre>X£-f-:7 

A*^x>F7l/-AST*Ol-77*y ^"^Hff L T 

[0062] 01 8 1±, mmmmm%.yis~-i±<r>&W)M 

JR (S7 1) (DWfflteyti— h£7jrr o X2— V. 

my is- i**7a vticftmL (S8D , &yuyt 

am*m?£Si-}ft?% (S 8 2) „ CWiv -fiS£ x 7*n 
■y ^ CO/ S * - y v -y ^ > ? t L T 6 txT U ^5 7a i* tc «); 
§yo-y^*^c07lx~A (0 5) HcDteMtCttJS 

[0 0 6 3] ±T<Dyuvi?\Z.ttl,m%^ h/W#t 
50 Si:, h-;l/OfI(c)SCT&ya-y^^a-rs 
( s 8 3 ) . ftm&¥kfr*> c coy U-A©#^»^5t< 

fe, GtfrTS (S 8 4) „ ^TaiiRtf^acoSmTj 

[0064] i msoyyv— L.cD&mmtf&tb'bnrc 

5>, 2ig©7l/-A« 3SB<07U-A^t^5<fc5tc 
(S8 6)\ ^T'b-AcoSailA^feStT- (S 8 
5) , U±(U&m (S 8 1~S 8 4) *m*)M?o 

[o o 6 5] ±y]s-i±<D<&mtfi&t>^rct> (S 8 
5) , &yis-2±frt>'&mmcDmm?z>yi'-.L%mm 
40 -rs (S8 7) o mi>mnA(o^yu-L.^mrj, * 
nzmmmnrnfey is- At-rs (sss) , 
[0066] sKw^$i$i5is^ (s 7 2) tmm<omi 
(s 7 3) *pb<iiB^-ri.„ fflw^iP^gifiT-^s-r 
2,mt>mmttmz, *7Vx.t bicftmztifcyay 
*<nm.n*mmmffi>t-?z>t,<DT-ibz>< > acorns, wm 
mmvmmt. ya-y^coxztuctiiff-tZo is^l^ 

ns mmmn^^mmT^ 
so [0 0 6 7] 0i Qit, mmmm.feyt'-.Lfribx.i/ 
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Y7\s-l±%.X'<Dh9-y*rl''? (S7 4) (OUM^yu 

<D7\s-l±*myis-L>£?% (S9 1) o BtHSftlCiiu 
(D7U-A«Dli*I5^71x-A(cntf-.b (S 9 2) , 

ccoav-LrzffimzwmmmtLT, S3, S73t 

|p)«tc, ^^x* h<D^WtC^^lK^^-y:5 (S9 
3) o iHWUBfcLfc^, Sl^-AtfxvF^U-A 
(S9 4) 0 I7U-A^F71/ 
-AT&Ctntf (S9 4) „ B^WK^^-AStIS 
71/-Ai:L (S9 1) « WOffll (S9 2, S9 
3) ZWiVm-fo l7U-Atfl>K71/-A©i^ 
(S9 4) , xVK7U-Ai:T*<D>^-y + >?"£:ii*7 

[0 0 6 8] 02Oti, WW^fPIS^y'b-AA^X^ 
-h7l/-L$T'Oh7.y*^ (S7 6) (Dl¥$ffl^7 

ffi<D7u-i±*m.yi'-L>k?2> cs i o i) „ mmw 

lcyK<D7ls—L.(Omn%:m7l>-J±fc3¥— L (S 1 0 

2) , <lcD=Jtf-Lfcte^S]WftfPi:LT, S3, S 

7 3 tiBi^jc, *7->*x* hcommcmmiti&j&intz 
(s i o 3) „ mmwj%.vrc'&. n^b-Atf**- 

Y7\s-L.-h^fr->tmi£?%> (S 1 0 4) „ m-7\s-l± 
t>^^-h7ly-L.xmftli£ (S 1 0 4) MffSmc 
fM<D7U-l±*m7ls-l±tV (S 1 0 1) , &M(om 
a (SI 0 2, S 1 0 3) ^rlSOilTo Si? b- A ft*;*. 
$-F7b-A««^ (S 1 0 4) , X?-h7l/-A 
* T'O h 9 V * ^^S&T L-fc C tc£ 5c 
[0 0 6 9] &tc, *7U-AO«f«*lifflt*. W 

2 WZ-TfctWilfcis— ^VXfc, 02 2tc^-r7a-^ + 

-h^titt, *o«¥J«*»8wr*. 02 it% ®s 

Mmt57\y— AF 2 1 ~F 2 5T*&t>, F 2 1 tfX^ 
-h7U— A, F 2 5 ib'iy K7.U-AT*fe5 0 
[0 0 7 0] 71/-AF 2 1 £r0 2 3 ic^f <fc 3 tCT^D 
•ytlcftmtZ (S 1 1 1) o 02 3TU 17b-A 
£7 x 5l©7n7 ^tc^fiJLTi/^o cn^7a7 
^<0»*a**ttlf* (S 1 1 2) „ 7U-iF 22% 
#^7U~Alc-ri.i:, 7b-AF2 1 i:OP^tc*l«W 

[0071] mcfhZ'V? V)v*ftm?z> (s i i 

3) o 7U- AF2 1 T'li, ^T070 7 ^tfiS^ffiO 
X'&2><DX\ *7iSji5 bVa-y ^^mmx^^^tc 
feOtU ^T^tl70 7^tt5„ *7->'i^h7 
n-y^otfc (ccT'(i-trn) SrCO? U-A©!fc5F$»<k 
LT«#-T5 (SI 14). 

[007 2] 025li, S113, S114 <D$a*I£>I¥ 



(11) mm 2002-56393 

tsHs-r s (s i 2 i) o nmt&2>7*vv*itm7Zi, 

(S122), *7->*x^ ht%57ny^^gt5 
(S 1 2.3) o WAtf, 7"D-yi'a^-S^I/^Oi&Sf 

itu -# a h^-r^o xtt, 7D7^ 

70 %C(07U-A<DRFlSa^ LTfiHTrS (S 1 2 4) o 
[0 0 7 3] *©7-U- AF 2 1 %Jl7 U~ Ai: LT 
(S 1 1 6) , 7~ny *{C#8lJt> (Sill), Eb#a 
^ItULT (S I 1 2K S7D7^^Sn (S 1 
1 3) o 

[0 0 7 4] 7U— AF 2 2 ti, 7U-AF Z 1 tmU 
{47U-AF 2 3 i:*§©T% ffi^41t^U5 0 

#S8-r 5 7 U-A(C $ -3 fc < 13) U7d v £ 

[0 0 7 5] vy^:/^©ffffilJ8»fcl!B**l5W\ -St 
«©fflcV>:/D >y ^fcRfctt Lfc«£\ 122 6 tc^-T <fc 3 
fc, fr*7Py? % t7i?x^h7D7^W, KHRi: 

B2 61f, 8S07P7i'*ll7'n^ < a»*©7 
50 D7^^tW7n7i'T'£!) > ^S^HSO^n -y 

7->'i^h7D7^T*W„ C<Dt#, «*:7ny*S 
» 19, t7->*x^h7D7^B5, «ff7n?>a 
« 1 1 T'&So 

[0 0 7 6] V-y^^DSWcSWRBfcAn* 

2«a©»*»cjiM&3m*o 02 7 tt*©$HH*s*<o* 

SCH«r*-r. £HK©7*o 7WtS7o7y. £££Mft 
07D7 tft-XWx.* h7t3-y?X&2> 0 C£Dl§-&lC 
tt, *5?7n -y * tf!7D -y ^ A^y->'x ^-F7o7 

fofirn^ciMHsnso h 2 7 icmtmxit, tt7 

40 D-y^|S{i2 9, t7y'i^h7D7^tt6t%5 0 
[007 7] 7l/-AF2 2d1flIi:LW->'x^ 
h7a-y*3&6£{£#-r3 (S 1 1 4) . 
[0 0 7 8] &71 — AF 2 1-F2 SfD^'x^ h 
7 p ny*»**7U-AO»««i:bT«*FUfc6 (S 
115), 7a?^»<0-ail*fl£t8 (S 1 1 
7 ) „ 0!IA{f , &7 b-A F 2 1 ~ F 2 5 ->*x ^ 

f-7-a-y^^Jt^L, 7-D-y^S^|3lU7U-A^ 
J65o 0 2 1 iCTn-rMT'li.. 7b-i>F 2 2, F 2 3lsj 
<D»jtaA^#<, 7 b- AF2 3, F 2 4 fig<Di!j#B 

50 tBI«»C**V^fl!)T?, *7"->*x^ b-7a-y^t^.m^tl 



-11- 



21 

ZZraytmr&^m&tZo 2 4, -F 2 5 

2<£&Wf£14?W^\, CftZ><DC£frt>, 71/- AF. 

2 2o^D^^^ma^^h¥ij^^n^o c^w^ 
« (sii8). 

[0079] ccom, m 1 7 tc^-rea?ziWffflfP^ 
cs 7 2) R^iPoiRm cs 7 3) tm<o mmvto 

5£ (S 7 3) ^7b/cB#^T\ 2 2*>6, 

0 2 8tC7l/-AF 3 2 T'^VX^-^tfffe tl 
3 0 xyF7l/-/.SWh77^>^ (S 7 4) T\ 
3 3-F 3 5(C^1-7X^f-^W#en, 
X^-h7l/-A$TOh77^>^ (S 7 6) T^U 

[0 0 8 0] 02 5m #®li:LT^x^h7 

^totk^^^ zft*¥fWLmtLTt>&i\ 02 9 
^ma^-r^^-a-o, s i 1 3ms i 1 4<ogi$^c*f 

[0 0 8 l] #7 r a7^<7)K^^ h^Ofg^fi^ 
46 (S 1 3 1) > fI7D7^^L (S 1 3 2) . 
^^v^x^h^n^^^^-r^ (S 133) o 7uy 

[0 0 8 2] 1$m7vvt7t*7>>j-t h?W?<D%L 
**»»M (S134.-S135) , ^colt^S# 
-T^ (S 1 3 6) o CtltCcfcD. &i&?Z>7tiyl7ktm 

[0 0 8 3] 13 0^ ^D^^^ffi^^®«^-r§ 

^Otf$S^«#b (S 1 4 4) . 71/- ABTffi»Oi 
«*Jt«LT— &tfte«5rr * c £ (S l 4 7) 
T, S*WtC, 02 2 ^[WICT'&^o 
[0 0 8 4] 03 Hi, S 1 4 4<DfiMfflfc:7n— — 

(S 1 5 IK f!7D7^^l (S 15 2),* 

7i/x^h7D7**i*m cs 1 5 3) o mnru 
v?<onftmt (s 1 5 4) . B»MT»6n*7uy 

*<D#S (S 1 5 5) *\ iW7P7^^i^7t 
«STMD£ a r (S 1 5 6) o 03 21^ 0 2 6tC^-r 
1S7p7^ (Qffi£<0;/n*y £0 ^2X2(D7D7^ 



(12) 1$H2 002-56393 

[0 0 8 5] B2 7fc5VrM<Ock3*C, »«±. 881?:/ 
ny>*«ft4i^ t^x.^h7 , D7^i:My 
□ *y * tc&LT^£ 7d v 5*mft7v vttTZCt 
fetf§ 0 0 3 3t±, 0 2 7lc^t"7n.y ^fijicfett 

*«wray^.oii»*jiajii*3R-r. 

[0 0 8 7] «H7P7fO»Stf«7Lft5» (SI 5 

6) , ^x?b7P7^oia*twu m-jnsjr 

«r^Ot7U-ixO#«fihLT«#-r§ (S 1 5 7) o 

[0088] ffi»<D— asepjje (s i 4 7) &7 

U-AcDit^x^ h©ffi«*lt«U 'ffi<D3fit/\fcO* 

ffi»ttifi<ttLfc«fc:fc4o 
[0 0 8 9] 02 1 fc^-TW^tt. 71/-AF 2 2 £y 
U-i,F 2 3 0R8©«I*S#*;#<< 7U-AF23i: 
71/- AF 2 4C0P^(Dii^St(WltlltC^:#0>O"e, C CO 
30 27U-AF22, F 2 3 <D*7 v^x * h <E>®ffi&jS^ 
ffilC*S^tett:&<ifi;t\, Ctl&<DCfc**6.-' 71/-AF 

2 2<D7uyzftffin&tfm^£nmztiz>t, yu- 

AF 2 2tfffl«*»KS7l/ ! -AJCft«SftS (S 1 4 

(S 7 2) fttflt«<Di|5BK (S 7 3) fc«< 0 
[0 0 9 0] 7ay*OS»*J*fTtoft^»'&, 
*7^x ^F7P7 ^OffiWte, (*y S^x * h 7n y 
x W7iS3L?h7uyl7(Dmmm £*%><> 

*zrz?jL?h7av2(Dmmm&-j£r*&%><DT\ 02 

[00 9 1] «BH7b-AOTRJESnfc«fj«-e, 
M71/-A (CCT^7l/-AF 2 2) OYX^f-^ 

(CCTU 7I/-AF32) ^»6tlT^*o 
ts x>K7l/-A$T'(0h77^>^ (S7 4) T*7 
1/-AF 3 3-F 3 StfTrX^x— *(§&*u X*-h 
7l/-^T'(Dh7-^^ (S 7 6) T-71/-AF 3 

50 -*#;Ra&&nfcc £*c&3 0 



-12- 



23 

[0 0 9 2] 0 3 5 It. *7i?x.2 b<DBViJ3& : &&Wl 

i?x.9b<mfflm*U#\* (s i 6 4) , yv-um 

■v&ttmn%)tmis?-m&*nfe?%.c t (s 1 6 

7) *(fe^T. S*«C, @2 2 irlBlUT'fe^o 

[0093] i36«, s i 6 4(omm^yo~^-^— 

(S 1 7 1) , *7>?x7 F7D7^^L (S 1 7 
2) . ftmfny (S 1 7 3) o 1W7d 

•y^coS^SJi: (S 17 4), WiMfiWS&tlST'n-y /o 
i'^I (S17 5)4, *J?7n7»OiMlltf87f 
•5*T«Slt)jI-r (SI 7 6) 0 

[0 0 9 4] m&7vvt(DftmtfW7-t%£ (S 1 7 
6) , *7S>x*h7n'j/*fc«j*7ny*©##Wc«J 

mmmzsmtsfev (s 1 7 7) „■ *<o#im«ttt£$i8 

<D*7iSjii7 b<DtfimziRM-£*tZ (S 1 7 8) „ Ctl 

e>©sas (s 1 7 7. si78) u, ^nfn, 0 1 7 

OXf'^S 7 2, S 7 3<D$SS£|q]i;T*£3o 

[0095] h3 7*#bbi;t» #*f*w»cBiiiirr*. b 

3 7 (a) ti, 0 3 2 fcaVf*-:7#x* Fifi33<D7o-y 20 
^^fc 03 7 (b) «, 03 2 (a) ICTr^^yiy 

ttTOft^TlUeLTtiJ:V\ 03 7 (c) tt, IflSWi 
$?#:*7^x * F ©fll&Ot&JBKiKJR LTl> < ifig*^ 
"To 03 7 (d) fi, «e«tiRjRbfe«*-e*»)> * 

3 7 tC^-f flJT'Uu *7-7x^ F<Dffi;i*S\ 03OTIB 30 
[0 0 9 6] tt&M£ttitft£ UT«#-r*tctt, 

tC&3cDT\ J£tf<D-|fcS¥ij5g (S 1 6 7) ©$aST\ ¥0 

[0 0 9 7] (S 1 

6 5) , &yU-l±fflT'BW<D-%l&%:mm-?Z> (S 1 
6 7) „ ffcfr^ *7U-AOJK«1I!«fcBB-r4«* 
tfc$£U ffl©ifi^fc©*#i&*. 

7n-y?©#jtStfi85£5©T-. *7->*x*F 
©?Btt*iE*(c#i& J f>rt\, 

ya-y9<D^m&i)m<, *7i?x.? b(DJEL^B 



2002-56393 

[0 0 9 8] @2 1lC^t«fSfl±, 7b-AF22t7 
U-A F 2 3 <DF^OK)€»3!)^# < , 7 U-A F 2 3t 
7b- AF 2 4<DF^(DK£B&|Bl«tC*£<^£)T% C© 
271/-AF2 2, F 2 3<D*7iSx.i> b<DBmS.!5.M 
•f *Rjfcg1±tfi&</\, CtlZVCbfrtb, 7U-AF2 2 

2 2*<«j)H*WHKt7U-Ak:»S«?n* (S 1 4 
8) o C©7U-A©$ti$firoc3£&5ftTV>5<DT\ 
0 2 8CD7U-— AF 3 2 cDVX^-r'-^fiKtc^Sn 
T^aci:^*,, C<Df£, Xv-K7b-ASWt-7 

(S 7 4) T-7I/-AF 3 3~F 3 SOVXi? 
-r-^#e>n, X^t-h7U-i 1 ST'iDh7'>*VJ r 
(S7 6) T7U-AF 3 1 ©TXi'f-^We.n 

[0099] *#bi»«\ mgwrnm-emmsnzme? 
[oioo] sfc, ±Misitmi&mo>Mk&mtr&* 

— * (CPUX(iMPU) *«»5Snrc7'o^AlcSe 
[0 10 1] C<Dl§-g\ Mf2V7 h7i7©7D^5A 

ftktm ffilAtf, 7P-vfcf- (SfltftflD f-fX 

A-Kf-fx^, ft-r-fx*, ftasm-rf x^, c 

D — R OM> ««tr— 7", 'J *- K&tf 

R 0 M H«rffl U > 5 C i: t±S3fc 5 . 
[0 10 2] 3^lfx-^A^*&$nfc7n^ 

'>X^A) XliiOTyj'ir— >3>V7 h7x7^Fi: 

[0 10 3] Mtli, «eStlft7"n^7A3-K*V 

3 > tT a - * <D«tt«»J!?- KXtt 3 > kf a tcS«! 



-13- 



(14) 

25 

tm#- Kxi*««aai3.-y mc**>s c p u myn 

[0 10 4] 

[0105] ^n-y^is. ffi«i»*«wi»tti»«*«« 
mt?zctT\ mm%J5mx'mmmmmfe7)s-.L* 20 

[0B©fa*^iKB^] 

[0 1 ] *?£W<r>m 1 ^SS09O«[BS«fiK^a 7vBT' 

[03] m2<D&mmmi&mm?z. as 2) <omm*7 

[0 4] SiblBWItimH3£0»*7U-AWT?»*.. 
[0 5] 0 4tC^-T7U— L>(Dyt(D7 U— LT'feSc 

[0 6] gibfflmtt^£0ffi9tt**avr^H? 
[07] mmofuvtftmctt-rzxy-iSjLt kd 

7*n >y * fcfclfc/a -y 

[0 8] 0 7tC^-T«?IJT-O%W7*n-y^^ayn-y 
9tom\s4m\sttVt<t>*'7&3. * h<D7n -y 17 
n-yi7^:^t* 0 

[09] i»«jwi®s?is^©«! ! a^*^-r^0T* 40 

STOh77*^(S6) col¥^^^n— ht* 

[0 11] «IHBIft*M8«7U-A^6^*-h7U- 
AST'Oh77^V^ (S 8) OS^7D-ft- h 

[0i2] 03 s £ d *mmv"- z tew Lrm 
[013] m\fo^irmMm<Dm2<DWift7u—=j-* 50 



&m 2002-56393 

26 

[0 14] Bl ^^-rHMi«lo*3 0»^7u-^-y 

[015] 0 nc^*r*ss^J^4o»^7.n-^^ 

[016] *58bh<dss 2 himow««7d 

[017] 01 G\ctt$mm<DmY?7u~?-*—Y 

[018] «j«Hitwia«7u-i,<Da»a!K (s 7 

1) OilS:7D^t-M*SSc 
[0 1 9] W«8«IWK«7U-^6jlvK7U-A 
(S7 4) cOPffl^:^n-^^-h 

[0 2 0] «I«BliSWRS7WA^6X#-h7U- 
ASTWh^y (S 7 6) 0«MW«::7 0-^*- 

[02 1] iff^-ir>XeijT*a&5o 

[022] 016 tc^-rnffi^jo. «t 0 jkw&ew 

[0 2 3] 7oy>»!PI8!lT*«o 

[02 4] 0 2 3fc^-r»*jrny *(c**bT*fttb* 

[02 5] S 1 1 3. S 1 1 4^MS^I¥ffl^^D- 

[0 2 6] «I7Dy^ *7^x^h7D7i'Sy 

[0 2 7] «I7D7*Stf*7yx* h7D7^© 

[02 8] VX*f-*MT'6«o 
[02 9] fft7oyjaWx*>7D7>8 
OJt**W««fcT5*&0, Sl'13StfSl HO 

[030] 7D7^ <Dpffl*1#$fi t-tZ>m\t7v- 

[03 1] S 1 4 4 08¥ffl£:70-*-*— hT*»*o 
[0 3 2] 0 2 6\cttmn7vy*&zrny2#9\ 

[0 3 3] 0 2 7^^-ryn^^^fiJtC^5^^i*W7 r 

[03 4] 2 SBBtTo fc«^(0»*J«S*T* 

[035] * 7 x * h C0^«^ffi^#a* t~?Z>W] 

[0 3 6] S 1 6 4<D!¥»&:7n-^* — h-e&£o 

[0 3 7] ttSBcOiRKiaSffyTfeSo 

[0 3 8] W)m>'-*>XlCl3tfZ>&7U-l*<D*7' 

1 0 : H^A^i^® 



-14- 



(15) 



^2 00 2-5 6 39 3 



27 



1 2 




1 4 




1 D 


— f n ... /7 ZA*g4dbS 


1 8 




2 0 




2 2 




2 4 




3 0 




3 2 





[Hi] 







25 


3 4 


3s4i 3?- lLi *t^9 




3 6 




IB 


3 8 


SRitus (Xti- 


ry, oir: \ -k£>. ill 


4 0 






4 2 


JAAir S/T. c±y *4- ss 




4 4 






4 6 






4 8 






[ 


02]- 





[03] 



10 



A* 



14 

«U1 



24 



[04] 



16 



IB 



fan _ 



S1 



— r 

12 



26 



Hi* 



S11 



ttff 

r 



[05] 




[09] 



£ 



83 -£ 
S4 



S5 



( ) 

1 




OK 



S6 -.X> /»*T 



X 



X 



[06] 



1 



S12-- ^D^C 



S14'- 



X 



I 



[0 8] 



[0 7] 




CO 



30 



A* 











4 


















y- 










C 






































1 








r- 














n 








1 

















[0 1 6] 



44 



Bft 




A*J 





. sat 

o: 



I 



gift 
40 



32 



"T 

46 




1 7] 



S71 _.fi»QmftR&7l 



T 



572 BnnjaiiMitt J 

7 

573 tt$KCPlK3fe 1 



S74 



X 



S75 — AiCBI 



X 



-15- 



(16) 



Wffi 2002-56393 




im 1 3] 



1 4] 



S42 




344 



S45 - [> 



S46 



I 



T 



S4£ - X^— A* 



CHID 



12 3] 



S43 
-V- 




S5! AOIBJBIS 



SS2 



S64 
-J— 



S58_ h7U-A* 

3 



12 4] 



1 9] 



„S94 




S91 ^ 87V-AI: 



[B2 0] 



( z£E± ) 



S101-- M©7V-A* 
S101-T jg 7 u-AJC 



T 



S102 - ^-A<^tt$P«: 

I 



SI 04 




( u»-> ) 



-16- 



(17) 



#882 0 0 2-5 6 3 9 3 



im 1 5 ] 



[0 18] 



12 1] 




SIR 



X 



QfzD 



12 5] 



F21 -> 



F22 



F23 



F24- 



F25-* 




[0 2 2] 



C111 3171 — ixQ>-fUy 

8111 *»a 



5112 + SHi#a»Hi 



sn4 4 txhmtfi 

S1 15 



Si 17 .7 D -j 9&<V-&m 
S118 -te)m7U—l><D&%. 

, i - 




X 



S122 —$&'?Vy!7<D®L% 



X 



S124 ^jtW*.* h^Py 
S1Z4 



12 7] 




[02 8] 



13 4] 



F31 



F32-" 




1111111 

xxx gsra >:->; -»:• n sn$ >>n 

CSSS •»> N KS 5cCS 

sasgaassassaag assess* 



(18) 



2002-56393 



12 9] 



[03 0] 



CE3 1] 



S131 ^.bXhyvAOffffi] 



I 



si 32 ~fff ? ?<z>ifej£ 

I 



£0> h 



S135 — jt?&x.9 h7u 



S136 



X 



8142 




S147 



( Eg ) 

S151 ^fc*hg3*Offtf| 





1 




SI 63 - 








r 




S164 — 








1 




S155 - 






S1S6 ^^JL^ 


N 







S157-^- ifflfctttS 



E 



I3 2] 




i 



F1 




13 53 



13 8] 



F2 



F3 





f0„ 
















F4 


F5 


RS 












S167 



S166 - 4«J«S7U---AO^| 



-18- 



(19) 



2 00 2-5 6 39 3 



[03 6] 



[03 7] 



Cig± ) 



5171 — ftXh^AOfWdEl 

' i • 

5172 — ffttyny?©^ 

— J — 



S174 



S17S -f «»7 nj ,^o 



S176 




"a 



si77 — aM©ws8e. 



sue ^gggptra > 



(a) 




(t» 




(4 



(d) 




-19- 



